-- Logs begin at Sun 2022-08-07 17:32:43 UTC, end at Sun 2022-08-07 18:41:50 UTC. -- Aug 07 18:06:24.341113 dv-cinder-849846-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 18:06:24.349722 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 18:06:24 2022] *** Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: nodename: dv-cinder-849846-9-iscsi Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: machine: x86_64 Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: clock source: unix Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: pcre jit disabled Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: detected number of CPU cores: 4 Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: current working directory: / Aug 07 18:06:24.351724 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: detected binary path: /usr/bin/uwsgi-core Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: your processes number limit is 47680 Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: your memory page size is 4096 bytes Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: detected max file descriptor number: 2048 Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: lock engine: pthread robust mutexes Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: thunder lock: enabled Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 18:06:24.352251 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 18:06:24.390755 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: Python main interpreter initialized at 0x55a169e4a9c0 Aug 07 18:06:24.390755 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: python threads support enabled Aug 07 18:06:24.390755 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: your server socket listen backlog is limited to 100 connections Aug 07 18:06:24.390755 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: your mercy for graceful operations on workers is 90 seconds Aug 07 18:06:24.391077 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 18:06:24.391167 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: *** Operational MODE: preforking *** Aug 07 18:06:24.391433 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: *** uWSGI is running in multiple interpreter mode *** Aug 07 18:06:24.391433 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: spawned uWSGI master process (pid: 80178) Aug 07 18:06:24.391613 dv-cinder-849846-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 07 18:06:24.393958 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: spawned uWSGI worker 1 (pid: 80186, cores: 1) Aug 07 18:06:24.393958 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: spawned uWSGI worker 2 (pid: 80187, cores: 1) Aug 07 18:06:24.393958 dv-cinder-849846-9-iscsi devstack@keystone.service[80178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 18:06:29.853141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:29.853141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: from cryptography.utils import int_from_bytes Aug 07 18:06:29.854052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:29.854052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: from cryptography.utils import int_from_bytes Aug 07 18:06:29.859556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:29.859556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: from cryptography.utils import int_from_bytes Aug 07 18:06:29.860058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 18:06:29.860058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: from cryptography.utils import int_from_bytes Aug 07 18:06:29.905150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 18:06:29.905358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 18:06:29.905513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] command line args: [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 18:06:29.905781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 18:06:29.905976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ================================================================================ {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 18:06:29.906224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] admin_token = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.906462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] config_dir = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.906642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.906817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] config_source = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.906993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] debug = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.907186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.907546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.907723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.907968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.908210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.908436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.908613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_config_append = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.908786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.908962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_dir = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.909134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_file = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.909287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 18:06:29.909369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.909497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 18:06:29.909646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.909736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] command line args: [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 18:06:29.909812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.909968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 18:06:29.910073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ================================================================================ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 18:06:29.910236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] admin_token = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_dir = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.910990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_source = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] debug = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.911965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_config_append = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.912986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_dir = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] publish_errors = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.913943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.914895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] standard_threads = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] use_journal = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.915907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] use_json = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] use_stderr = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] use_syslog = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.916825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.917077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.917077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.917318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.917451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.917451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.917744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.917744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] publish_errors = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.918013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.918155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.918294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.918418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.918543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.918667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.918791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.918923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.919049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.919180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.919312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.919438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] standard_threads = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.919568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.919704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.919830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.919989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.919989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.920283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.920408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_journal = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.920408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_json = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.920652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.920776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_stderr = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.920776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_syslog = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.921009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 18:06:29.921276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.921946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.922839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.923926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.924960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.925993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.926756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.927632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.928909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.929951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.930965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.931877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.932999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.933922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.934895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.935929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.936982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.937872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.938967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.939863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.940959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.941846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.942905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.943051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.943255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.943418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.944892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.external = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.945927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.password = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.946989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] auth.token = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.947900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.948961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.949866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.external = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.950968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.password = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.token = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.951989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.952902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.953989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.954994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.955910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.956948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.957856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.958929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.959915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.960892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.961953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.962880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.963914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.964962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.965736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.966933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.967990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.968892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.969968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.970917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971574 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.971964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.972883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.973810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.974923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.975912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.976973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.977915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.978969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.979997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.980957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.981949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.982874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] role.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] role.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.983899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.984812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.985964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.986894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.987912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.988934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.989855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.990012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.990141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.990891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.991935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.992974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.993869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.994952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.995991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.996892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.connection = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.997971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.998919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:29.999876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.000871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.001840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.002963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.004126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 18:06:30.005275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 18:06:30.019874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.020102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.020325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.023675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.023905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.024130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.030422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.033777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.058695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.058919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.060681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.060913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.110090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.110665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.160842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.161183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.161878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.162787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.227580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.227831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.228850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.229091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.229275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.229489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.251972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.252932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.263919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.264261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.277290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.277521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.277693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.277829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.278886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.279018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80186) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.279103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.279103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 18:06:30.295324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.295432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.295565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:30.295646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:30.295856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.295974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:30.296178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 18:06:30.296314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.296981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.297094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.297237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.308384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.308621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.308706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.308902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.308985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.309172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.309264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.309456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.316152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.316396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.319803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.320048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.320135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.320984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.321996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.322824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.345638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.346049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.347247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.347529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.347612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.347843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.352662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.352943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.353031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.353223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.353305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.353550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.359783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.360067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.360190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.360418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.364077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.364366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.364480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.364647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.364774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.364927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.365943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.366121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.366222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.366495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.382242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.382522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.382798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.383079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.386599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.387020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.389734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.390057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.390201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.390513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.394692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.395159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.397964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.398423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.401107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.401409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.401591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.401676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.401910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.401996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.402211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.402306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.402497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.402580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.402776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.403066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.418979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.419270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.419537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.419618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.419800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.419881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.420098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.420366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.426650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.427345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.428268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.428546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.429017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.429301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.431368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.431654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.431945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.432135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.432219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.432427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.432517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.432728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.433020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.433309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.444411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.444695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.444974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.445253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.445338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.445533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.445617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.445806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.445917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.446106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.446190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.446416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.446695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.446975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.462550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.463761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.465481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.466764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.468425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.469738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.470015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.471366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.471518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.471811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.472102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.472866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.473164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.473448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.479088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.480509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.480692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.482175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.483663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.483955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.484241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.484517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.485361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.485658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.485974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.486258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.493713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.494044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.494411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.498124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.498477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.498766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.501298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80186) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.501580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.501867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.502169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.502439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.502709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.502980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.503245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.503674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.503956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.504246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.504511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.504784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.505046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80186) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.507968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 18:06:30.508324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.508619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.508903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.509181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.509475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.509752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.510042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.510432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.510724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.511002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.511268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.511548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.511813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 18:06:30.539038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a169e4a9c0 pid: 80186 (default app) Aug 07 18:06:30.542384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba692ba8-b9f0-45ee-a1a4-fdd3ac201d19 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:30.542666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba692ba8-b9f0-45ee-a1a4-fdd3ac201d19 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:30.542935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba692ba8-b9f0-45ee-a1a4-fdd3ac201d19 None None] PATH_INFO: `/v3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:30.545833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a169e4a9c0 pid: 80187 (default app) Aug 07 18:06:30.547153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Sun Aug 7 18:06:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:38.171432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:38.172001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:38.172001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:38.176276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:38.182289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:38.182711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:38.182832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:38.252626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: INFO dbcounter [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] Registered counter for database keystone Aug 07 18:06:38.272037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG oslo_db.sqlalchemy.engines [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 18:06:38.278110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writer thread running {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 18:06:38.455055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG passlib.handlers.bcrypt [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80186) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 18:06:38.455381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG passlib.handlers.bcrypt [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80186) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 18:06:38.509423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:38.511062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:38.643428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 07 18:06:38.676113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:38.745851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: INFO dbcounter [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] Registered counter for database keystone Aug 07 18:06:38.767039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG oslo_db.sqlalchemy.engines [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 18:06:38.773446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writer thread running {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 18:06:38.891482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac9cc-cfcd-43ae-925e-4b90bdecdbb6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:38.896025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:38.897160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:38.897436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:38.897696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:38.905796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:38.956877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING keystone.common.rbac_enforcer.enforcer [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 18:06:38.957214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ebeb8-9b67-4d89-af48-3cb8c0f3f6ec admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:38.966920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Sun Aug 7 18:06:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:06:38.972782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:38.987470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9daff-d813-4563-8d4c-b00943cfb82e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:38.991918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:38.993005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:38.993281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:38.993545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] PATH_INFO: `/v3/projects/ca66a08084ae46fb86e1033ed40d8182` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:38.994988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca66a08084ae46fb86e1033ed40d8182)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:39.045020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 18:06:39.045306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722bcaa-8b44-44e4-877e-2b984dc7f027 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:39.049760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Sun Aug 7 18:06:38 2022] GET /identity/v3/projects/ca66a08084ae46fb86e1033ed40d8182 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:41.006348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed14e-99b2-4d1f-9d41-e494792cfb85 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.006870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed14e-99b2-4d1f-9d41-e494792cfb85 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.006870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed14e-99b2-4d1f-9d41-e494792cfb85 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.010936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:41.016318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.016679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.016848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.038412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:41.039911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:41.047674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 18:06:41.068997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ed14e-99b2-4d1f-9d41-e494792cfb85 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.080699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ed14e-99b2-4d1f-9d41-e494792cfb85 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.085323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.085915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.086207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.086473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.093914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.095659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dc2b1-1e55-4df8-b5f5-b36458cb8ce3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.104894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:06:41.109838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:41.118551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e1e18-e7e7-448f-868a-f07350e0fb93 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:41.122876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:41.123476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:41.123752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:41.124019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:41.125309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:41.127131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1237d2c-f2e4-4f38-a05a-e1310265434d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:41.128621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Sun Aug 7 18:06:41 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:43.180922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6968297-4b52-443c-9bb0-3ed1ea817322 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.181418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6968297-4b52-443c-9bb0-3ed1ea817322 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.181418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6968297-4b52-443c-9bb0-3ed1ea817322 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.182822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:43.187889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.188278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.188451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.189456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ac79e-0f9a-4b55-8f84-3c6a376c0ebd None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.189740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ac79e-0f9a-4b55-8f84-3c6a376c0ebd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.190045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ac79e-0f9a-4b55-8f84-3c6a376c0ebd None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.191243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:43.196485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.196766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.197034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.206770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:43.207938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:43.241053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG passlib.handlers.bcrypt [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80187) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 18:06:43.241453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG passlib.handlers.bcrypt [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80187) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 18:06:43.286322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:43.288424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:43.289618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:43.312429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.336429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.386007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:43.408399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.419251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548e55-daf8-4a3e-b320-81ac517edd35 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.452319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.452882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.453156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.453433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.464832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:43.473591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:43.475141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:06:43.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:43.481435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.517673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c559fa-a9ea-42a1-93d6-312e501be208 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.520533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.556074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.556922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.557200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.557466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.562663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.581208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885be7-8abe-419b-948a-43f205a60a7c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.616400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.616998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.617273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.617539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.618224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:43.618520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.619892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.624119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.625623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.630900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:43.636398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.742734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:06:43.748483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.751575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.844971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636812f-a213-4ea6-a2b7-60d0f92700db None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.852907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4d265-9d0f-4c17-baaa-c7a3a2078302 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.878755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.879471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.879755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.880028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.881163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.882690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.884682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:43.888035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:43.888893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:43.889173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:43.889444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:43.889817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.904840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:43.908859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:43.910368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:06:43.928790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:43.929845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:06:43.930892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:06:43.930892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:43.930892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:43.930892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:43.937150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:43.991795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f2ed-5644-4294-8b38-62b5a2edc9ef None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:43.997086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:44.026442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:44.027082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:44.027357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:44.027628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:44.028745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:44.030237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:44.032004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:44.038150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:44.041965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50780-7ded-4d0b-ac40-f1440e817bd1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:44.080585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:44.081202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:44.081486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:44.081744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:44.082498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:44.083049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:44.085889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a1b86-9ea9-485c-94c4-be4b76c6c6a1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:44.103228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:44.122838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:44.144294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db43-c94b-452a-8cb9-37bd197d7a6c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:44.180108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:44.180727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:44.181002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:44.181279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:44.182116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.domain.id=default, user.id=beb9f8a0db28411a976c62690df62487) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:44.182419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:44.183914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31e5be-83f3-4ba2-a50f-6257667494d5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:44.191271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Sun Aug 7 18:06:44 2022] GET /identity/v3/role_assignments?user.id=beb9f8a0db28411a976c62690df62487&scope.domain.id=default&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:46.508927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ea52-0428-40e7-9840-86e39b95ceb7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.509458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ea52-0428-40e7-9840-86e39b95ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.509458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ea52-0428-40e7-9840-86e39b95ceb7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.511088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:46.524805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.525737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.526226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.552784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:46.554408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:46.609391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c06f4-e8b5-4033-b8c3-d2e00ac5711c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.610059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c06f4-e8b5-4033-b8c3-d2e00ac5711c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.610536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c06f4-e8b5-4033-b8c3-d2e00ac5711c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.612294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 12/23] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:46.618966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.619465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.619951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:46.643112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:46.644567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:46.687583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.728441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.776171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:46.810837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:46.872708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.910262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:46.925814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8cbd-62aa-491f-a5f7-5b163efbcec2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:46.997543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:46.998210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:46.998485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:46.998754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.012606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0c25c-df1d-4f2d-9bba-cc4f5c9f0060 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.020423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:47.025301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:47.026264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:47.027023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:06:47.029419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 13/26] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:47.035206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.171331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.172020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.172292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.172599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.191886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.193431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dabc7fba-632d-4a3e-aaa2-ae9aa724877d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:06:47.228443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:47.229357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:06:47.230178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:06:47.230178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:06:47.230178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:47.231869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 14/27] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:47.239545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ef58-da70-401c-8e16-504ef3aaf667 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.243330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2a57-805a-4d90-a87e-466b542dd176 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.243607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2a57-805a-4d90-a87e-466b542dd176 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.243874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2a57-805a-4d90-a87e-466b542dd176 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.245379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 15/28] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:47.245857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a2a57-805a-4d90-a87e-466b542dd176 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.293820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.294806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.295288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.295767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.296725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:47.297307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.298927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a6f2-ab63-40ee-9b8b-a62a9a9fd46f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.308260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 14/29] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:47.308765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.313673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.314506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.315060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.336228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:47.338340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:47.399987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.405850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a2a57-805a-4d90-a87e-466b542dd176 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.419758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:47.420976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.464636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.465305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.465578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.465889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.466565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:47.467196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.468470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691c83-7dc2-4a5b-bcbd-16bc776ec7d4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.484543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 16/31] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.491533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c6f2-cb3f-438f-a6e4-509ce88ac825 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.491812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c6f2-cb3f-438f-a6e4-509ce88ac825 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.492077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c6f2-cb3f-438f-a6e4-509ce88ac825 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.494122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 17/32] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:47.494385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c6f2-cb3f-438f-a6e4-509ce88ac825 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.530805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6870ef-88ce-43c1-833e-2e2be8a287d9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.559635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.572850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.573505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.573762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.574069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.575205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.576943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.579686 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 16/33] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:47.580507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.622376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2c6f2-cb3f-438f-a6e4-509ce88ac825 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.666560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.667599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.668557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.669009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.670151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.672624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdf32-0b82-4dc1-9673-5d75b15785bf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.710074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3c66-c3d2-42e8-b124-0aa88a1b8a4f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:47.746392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:47.746995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.747265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.747643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.748284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:47.749710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:47.806321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 18/34] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:47 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:47.807768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b246a-e312-4ca1-9738-021bfa093f56 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.808056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b246a-e312-4ca1-9738-021bfa093f56 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.808331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b246a-e312-4ca1-9738-021bfa093f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.829287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-301b246a-e312-4ca1-9738-021bfa093f56 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:47.830882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-301b246a-e312-4ca1-9738-021bfa093f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:47.847773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:47.889005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 17/35] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:06:47 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:47.890450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:47.926944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:47.931364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd089d-c162-4623-b386-005992e8d94b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.931706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd089d-c162-4623-b386-005992e8d94b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.932032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd089d-c162-4623-b386-005992e8d94b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.933396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 20/37] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:47.939076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:47.939442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:47.939795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:47.962968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:47.964226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:47.990331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.076431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85062-152b-4065-859e-6192ee45e68c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.082013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 21/38] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:48.083047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.123071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.123735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.124018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.124291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.126245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.127834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bf68f-798b-4f8c-a47d-84f0d58ee5bf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.129432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 18/39] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:48.130778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f270-22d3-4a57-a667-ca63cd855277 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.131060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f270-22d3-4a57-a667-ca63cd855277 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.131336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f270-22d3-4a57-a667-ca63cd855277 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.132626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 19/40] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:48.133310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f270-22d3-4a57-a667-ca63cd855277 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.171916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.195028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d945-159f-4a97-8be0-fd055d6f40f5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.228640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.229260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.229540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.229815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.230512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.232018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a5682-6c95-4a74-8d36-b3c0e89923fb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.240075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f270-22d3-4a57-a667-ca63cd855277 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.245987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 22/41] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:48 2022] POST /identity/v3/roles => generated 225 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:48.247166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.247448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.247722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.266016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.266881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:48.268125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:48.289933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.290557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.290835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.291105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.291780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.293247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.312602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 20/42] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Aug 7 18:06:48 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:48.313834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.368908 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 23/43] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:48.398549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.458835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467bb1c-dcbb-4e8a-bd14-d6e185e21bb9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.486973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.508258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.508790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.509070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.509374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] PATH_INFO: `/v3/domains/default/users/beb9f8a0db28411a976c62690df62487/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.511393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=beb9f8a0db28411a976c62690df62487, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.512860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.528927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 21/44] 10.222.0.30 () {58 vars in 1361 bytes} [Sun Aug 7 18:06:48 2022] PUT /identity/v3/domains/default/users/beb9f8a0db28411a976c62690df62487/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:06:48.529249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fedd8-d192-48f7-a906-5d0fbd8b7073 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.571076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced987bd-b77f-4167-9899-788976162827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.571722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced987bd-b77f-4167-9899-788976162827 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.572001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced987bd-b77f-4167-9899-788976162827 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.572269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced987bd-b77f-4167-9899-788976162827 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.573708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced987bd-b77f-4167-9899-788976162827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.575247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced987bd-b77f-4167-9899-788976162827 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.577155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 24/45] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:48.583118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:48.620819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:48.691640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0f50e-d322-41a7-96e2-d73020a8fd8c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:48.724928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:48.725535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:48.725811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:48.726122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:48.726758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:48.728191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e2d5b-0794-4c4e-85c1-6c6a7a8f8cce None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:48.752825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 22/46] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:06:48 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:50.534222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7222f-3a74-4d94-9701-965e2595089d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.534769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7222f-3a74-4d94-9701-965e2595089d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.534769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7222f-3a74-4d94-9701-965e2595089d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.536115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 25/47] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:50.541851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1b7ee-ee50-47a6-80c1-99b889008536 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.542259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1b7ee-ee50-47a6-80c1-99b889008536 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.542432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1b7ee-ee50-47a6-80c1-99b889008536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.560832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1bb1b7ee-ee50-47a6-80c1-99b889008536 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:50.562349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1bb1b7ee-ee50-47a6-80c1-99b889008536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:50.626531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 23/48] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:50.649323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7222f-3a74-4d94-9701-965e2595089d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.749533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7222f-3a74-4d94-9701-965e2595089d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.749995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ee2a-29b0-4a14-83aa-d4bf0902047f None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.750290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ee2a-29b0-4a14-83aa-d4bf0902047f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.750570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ee2a-29b0-4a14-83aa-d4bf0902047f None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.751924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 24/49] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:50.756913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.757192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.757463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.774901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:50.776075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:50.782869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.783507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.783785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.784058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.787127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.788075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:50.796610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:50.803482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:50.804313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:50.805105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:50.811926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.848338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 25/51] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:50.871290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.909325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a41e-a3a1-4228-a59f-020c64a69d80 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:50.942237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:50.942893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:50.943173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:50.943441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:50.944101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:50.944400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:50.945788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:50.957187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 27/52] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:50.963124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:50.969012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334890-017c-4bbc-bc58-b50a74124b15 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.003281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.003919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.004193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.004460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.006197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.007642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.009326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:51.015058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.020262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.030088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.061217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081b92-d37c-470a-a88f-143049dff9b5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.094338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.094971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.095254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.095534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.096893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.098388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.100007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 28/54] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:50 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:51.105307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.112990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f359d-b505-48b5-8bc3-a7be49822970 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.148642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.149242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.149516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.149785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.150463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.151881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.179086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 27/55] 10.222.0.30 () {60 vars in 1140 bytes} [Sun Aug 7 18:06:51 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:06:51.206242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d7bd-c866-4602-844d-a1fee336e49b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.234210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.244289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.244950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.245233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.245505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.246699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.248176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c54ed2-56e9-4af5-9bb1-b4e04274f1b2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.249771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 29/56] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:51.255834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:51.323562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:51.361128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272272a-17aa-4397-bbc1-837fef8c3b4e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:51.394392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:51.395000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:51.395278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:51.395549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:51.396279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.domain.id=default, user.id=beb9f8a0db28411a976c62690df62487) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:51.396582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:51.398039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241510-b3bf-48f8-bb6a-6840c97e9517 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:51.403642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1322 bytes} [Sun Aug 7 18:06:51 2022] GET /identity/v3/role_assignments?user.id=beb9f8a0db28411a976c62690df62487&scope.domain.id=default&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:53.183335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cf40-994b-4cdd-ab2d-00bea08c5cec None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.183825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cf40-994b-4cdd-ab2d-00bea08c5cec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.183825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cf40-994b-4cdd-ab2d-00bea08c5cec None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.185130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 30/58] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:53.190260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.190678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.208755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:53.209945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:53.273164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 29/59] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:53.295743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858cf40-994b-4cdd-ab2d-00bea08c5cec None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.394600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858cf40-994b-4cdd-ab2d-00bea08c5cec None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.429127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.429756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.430070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.430346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.431453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.432886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443cc76-d16a-49c9-ae77-b6714e1c6810 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.434544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 31/60] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:53.440067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:53.496768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:53.535629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f55ba0-a1ed-4dff-8b03-d149f92a5755 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:53.568944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:53.569538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:53.569815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:53.570108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:53.570736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:53.572165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6053b0-723f-4dcd-9c7b-c6b012d25953 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:53.597249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 30/61] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:53 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:56.659934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926168f-166e-4d2b-a372-712975660a04 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.660948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926168f-166e-4d2b-a372-712975660a04 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.662033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926168f-166e-4d2b-a372-712975660a04 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.663843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 32/62] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:56.668930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.669748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.670242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.694883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:56.696433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:56.702650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7480b4-d871-4832-86f9-0f4e7a43b438 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.703195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7480b4-d871-4832-86f9-0f4e7a43b438 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.703656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7480b4-d871-4832-86f9-0f4e7a43b438 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.705209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 33/63] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:56.710459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e84a1-5dfe-4051-bfc5-1278fdfa56a6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.710992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e84a1-5dfe-4051-bfc5-1278fdfa56a6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.711462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e84a1-5dfe-4051-bfc5-1278fdfa56a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.742020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-342e84a1-5dfe-4051-bfc5-1278fdfa56a6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:56.743235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-342e84a1-5dfe-4051-bfc5-1278fdfa56a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:56.817943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 31/64] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:56.836432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.849165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.865689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 34/65] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:06:56.923851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:56.924136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22057c8-2375-4083-a5f0-1f960fb9bb10 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:56.924620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22057c8-2375-4083-a5f0-1f960fb9bb10 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:56.925079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22057c8-2375-4083-a5f0-1f960fb9bb10 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:56.926631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 35/66] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:06:56.928127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22057c8-2375-4083-a5f0-1f960fb9bb10 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:56.980411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a2d9-76f1-4322-af97-2d2236e5c38e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.015849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.016814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.017307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.017781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.031478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-75fca81a-e0ff-4cde-8077-277d8b69d5d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:57.036829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:57.037651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:57.038768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:06:57.040800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 32/67] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:06:57.047294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22057c8-2375-4083-a5f0-1f960fb9bb10 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.047803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.048222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.048627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.072474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:57.074033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:57.082529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.083920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.084334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.084742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.096395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:57.101484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:57.102344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:06:57.103105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:57.105277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 36/68] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:57.106271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.149478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 33/69] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:57.150833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.161072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.191041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.213747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0ded6-cd59-48c5-93d3-32030ae5271c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.249254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.249864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.250174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.250449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.251115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:57.251420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.252790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c873-1833-4256-8518-c34864df002c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.261245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 37/70] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.262120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95865bdd-290e-4817-bbbd-cfe7e1eb3a73 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.263124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0285dc4-a44e-473c-9d4b-df70c18c71d0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.263725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0285dc4-a44e-473c-9d4b-df70c18c71d0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.264185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0285dc4-a44e-473c-9d4b-df70c18c71d0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.266087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 38/71] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:57.266798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0285dc4-a44e-473c-9d4b-df70c18c71d0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.308021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.308638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.308915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.309182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.310404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:57.310711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.312578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.323241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 34/72] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.324245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.384023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0285dc4-a44e-473c-9d4b-df70c18c71d0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.398703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.420284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.420909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.421186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.421452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.425205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.429117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98262-cd9f-4a97-a13f-9d618c67e228 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.431980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a25df16f-6510-41e9-a179-33b05f6735d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:57.436723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:57.437573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:57.438367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 39/73] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:57.439231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30422-4b51-44df-af93-a0cba3875ba1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.439459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30422-4b51-44df-af93-a0cba3875ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.439714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f30422-4b51-44df-af93-a0cba3875ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.457453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c8f30422-4b51-44df-af93-a0cba3875ba1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:57.459180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c8f30422-4b51-44df-af93-a0cba3875ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:57.468473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.469554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.470024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.470308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.494503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.496166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.497827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 35/74] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.498634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.527986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 40/75] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:57.529240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb11ce-7d47-4bca-91c3-19d7b4ab1464 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.529516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb11ce-7d47-4bca-91c3-19d7b4ab1464 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.529789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb11ce-7d47-4bca-91c3-19d7b4ab1464 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.531047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 41/76] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:06:57.531732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb11ce-7d47-4bca-91c3-19d7b4ab1464 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.597862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c96c-4ecf-4814-a8f9-3a54fe6882b1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.630964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.631588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.631874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.632154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.633270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.634747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.636304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 36/77] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.637186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.645841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb11ce-7d47-4bca-91c3-19d7b4ab1464 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.648484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.665602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.681313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.681945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.682230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.682504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.683162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:57.683464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.684833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda3d7e-d14d-44bd-a13f-5372cf745439 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.692596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 42/78] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:57.692596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.692596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.692596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.713827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:06:57.714987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:06:57.738753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65699ad-dc3b-4a27-bd3b-148edb4d1b2b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.772714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.773330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.773612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.773886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.797929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 43/79] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:06:57.797929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.843637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:57.845150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:57.868989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.882127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:57.889919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e029f-63f7-4aad-a8e0-15c4fd7de24c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:57.924120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:57.924751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:57.925030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:57.925298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:57.935825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:06:57.940586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:06:57.941435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:06:57.942240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 44/80] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:06:57.950969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 37/81] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:57.951110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:57.951198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.044564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214be43c-2ac2-4cee-a2b3-a77fe1a54bc9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.046098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241174-cd08-4a91-a3d0-0ca35164ba90 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.067095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.078659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.079283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.079566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.079838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.080936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.081493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.082130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.082414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.082504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.082688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.084053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 38/82] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.088621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.107330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.154778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.156257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.185084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786ccc1-65a6-4aef-b3b3-cb401130b764 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.218489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.219113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.219399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.219671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.220773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.222252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.224121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 39/83] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.224718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.253146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 45/84] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:58.254039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.286623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.309702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.326725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb975c02-5bdc-4027-a1f5-8e1d801f89f8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.352312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069fc28-641f-4c6e-8039-b44db124a36e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.360115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.360715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.360995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.361271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.361956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:58.362259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.363648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.372408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 40/85] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.373199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.386063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.386688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.386962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.387229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.388331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.389834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.391455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 46/86] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.392183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.471471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bb15-a3da-4163-87a9-eee5b7cdc944 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.488267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dcca2-eb77-4fe2-a576-5bbc891167c9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.494231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.505846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.506471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.506751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.507020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.511708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.523177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.523768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.524043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.524310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.524935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.526390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.552948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 47/87] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:06:58 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:06:58.554831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.584476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.586014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.675244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc9f2-0b76-4789-80a1-5f9de6c9e1f9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.694247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 41/88] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:58.695305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.721665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.722323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.722599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.722866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.724524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.726040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.726930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.727961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 48/89] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.728787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.784888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:58.817830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46ce4f-1b0f-4c76-bc9d-7f69f3416d9a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.851928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117ef5-8abc-4ab8-b391-1ba1100e1f62 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:58.867312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.867973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.868263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.868523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.870597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.872699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.877229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 42/90] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.877229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:58.917049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:58.917680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:58.918000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:58.918261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:58.920311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:58.920311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:58.920737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:58.933709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 49/91] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:58.937252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.015570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.027850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fe168-1da3-46cb-9b11-560a43c8e1df None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.041959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ae455-de39-44a7-aa1e-f3c49c275e33 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.061252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.081397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.082124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.082680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.083731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.084547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=beb9f8a0db28411a976c62690df62487) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:59.084975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.086626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.090783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.091705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.092180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.092616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.093710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 50/92] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/role_assignments?user.id=beb9f8a0db28411a976c62690df62487&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.094526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.098414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.098959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.104544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 43/93] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:58 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.106669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.302864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461f0e-9d2d-499a-864e-cb65c4c0671a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.350023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59253e1-cb51-4bf4-8743-2ded2f068457 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.366907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.367449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.367727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.367998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.418187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.418808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.419086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.419357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.420088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:06:59.420391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.421842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.437501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 44/94] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:06:59.460369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.502112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.503856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.639682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:06:59.645913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:06:59.697388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:06:59.812145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaef23-2fa6-475a-b4fe-2d2b886981d0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:06:59.871593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:06:59.872349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:06:59.872580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:06:59.872860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] PATH_INFO: `/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:06:59.877117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] RBAC: Authorizing `identity:get_project(project_id=c7a57bcb38a14621b3ed6e3011e9ec39)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:06:59.877117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ce91-b1f2-4cb9-a299-c8d7957b304a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:06:59.878240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 45/96] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:06:59.894008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:00.028205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:00.065026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189cfbc-ee5c-4179-b867-58c27e145c74 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:00.102541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:00.103155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:00.103435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:00.103707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:00.104448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=c7a57bcb38a14621b3ed6e3011e9ec39, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:00.104758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:00.106232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36552e64-89c5-4213-8acc-ec357ac93a5a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:00.112191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 52/97] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:06:59 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=c7a57bcb38a14621b3ed6e3011e9ec39&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:01.561731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328203-0057-4115-b356-1e8323fad293 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.561731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328203-0057-4115-b356-1e8323fad293 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.561731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e328203-0057-4115-b356-1e8323fad293 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.561731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 46/98] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:01.579738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.580234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.580307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.602886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:01.603821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:01.649926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b216bb-4450-4f5f-ba44-9ed1d35ea131 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.649926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b216bb-4450-4f5f-ba44-9ed1d35ea131 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.649926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b216bb-4450-4f5f-ba44-9ed1d35ea131 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.651637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 47/99] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:01.656990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.657487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.658006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.679373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:01.681157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:01.712991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 53/100] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:01.735969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:01.785328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:01.812389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:01.835482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:01.838194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:01.881729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f018b-dd61-4f2c-9caf-a4f9e6a11342 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:01.930633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:01.938241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.938815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.939327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.948244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55ee8-7806-4572-ae1e-1497fe3fcaa9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:01.982956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-af75b8a4-9a73-44f2-8232-c494eaf32011 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:01.987810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:01.988681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:01.989524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 54/102] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:01.990958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387a1e-27c4-4b3c-bf4b-9cad20ff3840 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.991384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387a1e-27c4-4b3c-bf4b-9cad20ff3840 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.991781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8387a1e-27c4-4b3c-bf4b-9cad20ff3840 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.997078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:01.997325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 55/103] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:01.997964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:01.998249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:01.998522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:01.998715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8387a1e-27c4-4b3c-bf4b-9cad20ff3840 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.019601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5cba99cd-da0a-4880-a929-552a068f70cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:02.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:02.032655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:02.033730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 49/104] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:02.034570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.034570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.034869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.068268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:02.069692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:02.151469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 50/105] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:02.152592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.170419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.189618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8387a1e-27c4-4b3c-bf4b-9cad20ff3840 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.227015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.230039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.230933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.231355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.231802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.232687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:02.233184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.235210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.244609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 56/106] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.246194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.290164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3120e15-de59-4efc-b247-6a84d6b8ddaa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.326793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.327738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.328205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.328701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.329653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:02.330199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.331824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd0dae-f77e-4147-af7b-aeb0ee55e3d1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.341735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 51/107] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.347956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f78da-3f60-4482-a047-3eeccd1f4a46 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.348477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f78da-3f60-4482-a047-3eeccd1f4a46 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.349548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f78da-3f60-4482-a047-3eeccd1f4a46 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.351133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 52/108] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:02.352580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f78da-3f60-4482-a047-3eeccd1f4a46 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.370341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcd419-72f2-46c3-9346-7753e3087cbd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.406496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.407486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.408045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.408504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.410151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.412405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.418017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 57/109] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.419275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.440557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.484178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f78da-3f60-4482-a047-3eeccd1f4a46 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.486252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.529776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.530802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.531396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.531960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.533570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.535758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9f9c-df56-4138-bbf2-f662f6bab00c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.537674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 53/110] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.538965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d2a29-488b-4d2c-9764-1090fed824af None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.539690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.540162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.540720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.564520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:02.566540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:02.579272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.580068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.580606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.580606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] PATH_INFO: `/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.599791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] RBAC: Authorizing `identity:get_user(user_id=af778c417d2e4c63aa8e2d6e03f3b0d3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.601254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.603032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 58/111] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.603828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.677891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 54/112] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:02.679155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.737634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6046e-1bca-4c09-bccb-5107e6f3eab4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.756606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.775319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.776036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.776312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.776577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.777210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.778659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce16f-dd4c-4fd1-9c83-ea47aa07fde1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.794739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:02.806704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 59/113] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:07:02 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:02.815518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d8cf-36f9-44dd-bbe2-897e51125f1b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.815943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d8cf-36f9-44dd-bbe2-897e51125f1b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.816193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d8cf-36f9-44dd-bbe2-897e51125f1b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.822578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 60/114] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:02.822578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d8cf-36f9-44dd-bbe2-897e51125f1b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.848745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6263-01fb-4c80-b79d-2e616a67de03 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.890357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.891472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.891990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.892462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:02.894288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:02.896131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:02.898184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 55/115] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:02.899215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:02.946052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d8cf-36f9-44dd-bbe2-897e51125f1b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:02.985629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:02.986301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:02.986581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:02.986852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.025149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf8c9-f3bc-44d0-a6f5-d6cbe0078e9e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.047375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.078640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.079281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.079557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.079826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.085840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.088444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.089296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.093883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-6376e5a7-1fc8-43f6-9f74-e6158fe7fff9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:03.100424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:03.101985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:03.103570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:03.108040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 56/116] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:03.109118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.109380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.114575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.141929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:03.143999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:03.225993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 61/117] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:03.227244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.253076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:03.253076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.310458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.344816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687ae1-1106-4c45-ab2b-14c88ce8e699 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.377195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae43030-54f8-4ede-9920-fe3b812271e0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.381430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.382302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.382719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.383125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/c57f9edf97cc4625b9968af12791928b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.385184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, user_id=c57f9edf97cc4625b9968af12791928b, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.386773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd0c84-57f9-4ab5-819f-6c54c0834f9d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.404235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:03 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/c57f9edf97cc4625b9968af12791928b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:03.405865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.407225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c74f-1fb1-49e3-ab4c-7c39e8f995b2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.408008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c74f-1fb1-49e3-ab4c-7c39e8f995b2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.408506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c74f-1fb1-49e3-ab4c-7c39e8f995b2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.412296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 63/120] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:03.416676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c74f-1fb1-49e3-ab4c-7c39e8f995b2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.422329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.423545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.423999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.424442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.425396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:03.425884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.428009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.438494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.439641 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.560047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476db5-1d85-49df-98d3-1aad67c5c9f1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.577060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c74f-1fb1-49e3-ab4c-7c39e8f995b2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.604563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.605252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.605531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.605803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.620339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.627560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-69f675c9-9755-4069-89e1-df5b58294bee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:03.632861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:03.633699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:03.634539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 59/122] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:03.635204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.635852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.635852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.636641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.637716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.638369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.638951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.640635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.644118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.646727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 64/123] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.647690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.660823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:03.661871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:03.715523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.739773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:03.746279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.787206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540acc9-cda8-41c9-a492-ddaa68a0b525 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.824540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.825179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.825509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.825789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.826982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.828406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.830180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 65/125] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.830814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.886774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e6089-0b9b-4b57-a399-08b5e0fad03c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.907811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:03.929442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:03.930225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:03.930510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:03.930784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:03.931463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:03.932125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:03.933504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:03.943242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:03.948658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:03.952451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824717d-b736-4557-b699-ac50b4fb44f7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:03.995866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.000447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.001060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.001344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.001614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.002392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=af778c417d2e4c63aa8e2d6e03f3b0d3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:04.002696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.004166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.010641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 66/127] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/role_assignments?user.id=af778c417d2e4c63aa8e2d6e03f3b0d3&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=88b25505d32b467e90329efbee33ec33 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.011467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.087884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072193c-af4c-4a16-8f73-8f54e93abe78 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.151382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dba59b-dde2-4b67-bad4-2ab686e89509 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.157011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.157666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.157971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.158253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.184443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:04.189880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:04.190807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 62/128] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:04.191987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.242706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.243481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.243657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.243895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.246196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.248825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.249717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.251492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 67/129] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.252277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.349931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc79db-fcc9-4dcb-acc8-e15e950e6bf6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.351932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.359435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb45e-138a-4ae8-8760-2bf7f1f84453 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.402707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.403326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.403621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.403899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.404160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.404568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:04.404872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.405433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.405928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.406279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.406591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.407923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.409677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.411669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 63/130] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.412599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.427839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 68/131] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.434882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.523202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2412bc6-db5e-4c9e-a1b0-6933dcab3628 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.550337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.559982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.560928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.561403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.561937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/beb9f8a0db28411a976c62690df62487/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.564262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, user_id=beb9f8a0db28411a976c62690df62487, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.566243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.591322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 64/132] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:04 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/beb9f8a0db28411a976c62690df62487/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:04.598188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff221b-4be7-45b2-96c1-0eb338e7e32d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.599644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.635229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.635936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.636163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.636437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.641637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.641637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.641637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 69/133] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.650019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:04.664800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.813788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791afa4-014b-434f-b566-e6eddd0b2fab None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.816701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28ce9-e2c9-4623-9ba3-0fd53f77842f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:04.845324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:04.855035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.856287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.856791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.857133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/c57f9edf97cc4625b9968af12791928b/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.860025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, user_id=c57f9edf97cc4625b9968af12791928b, role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.861584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.882186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 70/134] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:04 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/c57f9edf97cc4625b9968af12791928b/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:04.918128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:04.918717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:04.918998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:04.919272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:04.920554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:04.922057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cfc4d-b7f1-46bb-acb5-dc42da8b0f30 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:04.924069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 65/135] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:04.929481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.062023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0853517-be35-4fb8-a619-29c7ad9f3bb7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.086803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413eee-85d0-4c34-917c-0a7b72ba3f8c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.087104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413eee-85d0-4c34-917c-0a7b72ba3f8c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.087358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16413eee-85d0-4c34-917c-0a7b72ba3f8c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.088930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 66/136] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:05.095059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.095343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.095619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.109328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.110022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.110309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.110588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] PATH_INFO: `/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.113503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c7a57bcb38a14621b3ed6e3011e9ec39)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.115578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.117643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 71/137] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:04 2022] GET /identity/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.123160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.139133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:05.140505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:05.205437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.259565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a02fd-2e65-4063-985b-051e02e926b0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.302111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.302782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.303064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.303265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 67/138] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:05.303628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] PATH_INFO: `/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39/users/c57f9edf97cc4625b9968af12791928b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.305674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=c7a57bcb38a14621b3ed6e3011e9ec39, user_id=c57f9edf97cc4625b9968af12791928b, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.307144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.324936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 72/139] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:05 2022] PUT /identity/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39/users/c57f9edf97cc4625b9968af12791928b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:07:05.347470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.392760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.479656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5b16-048a-4b2e-ae90-610fd6abacce None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.518071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.519035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.519316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.519586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.521378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.522846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836e2e-e9bb-4af6-a6f6-a88d6b70852b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.524626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 68/140] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:05.531781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:05.644815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d118f45-39f3-4481-8ab0-04bbe2513c8e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:05.670322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:05.686497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:05.687119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.687402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.687676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.688346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:05.689785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fbea-6b9a-4ae4-a835-52dbc5e588cb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:05.717404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 73/141] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:05.884390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37ca0-9a2c-4c6a-9986-9dc883bc6ab2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.884902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37ca0-9a2c-4c6a-9986-9dc883bc6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.884902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37ca0-9a2c-4c6a-9986-9dc883bc6ab2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.886303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 69/142] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:05.894341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:05.894640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:05.894898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:05.920539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:05.921752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:06.009376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 74/143] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:06.033103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37ca0-9a2c-4c6a-9986-9dc883bc6ab2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.133978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.144470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37ca0-9a2c-4c6a-9986-9dc883bc6ab2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.186026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.186717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.186997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.187269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.202355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:06.207283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:06.208163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:06.208915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 70/144] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:06.215627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.339814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef8d0b-c789-43f4-bcd0-dde8f82c14e9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.341385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.387985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.388608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.388881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.389196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.389873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:06.390193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.391561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.406022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 75/145] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.411925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.551433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa25a0-2ba2-4a17-ac4a-96726d3927ca None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.597940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.599584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.600056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.600518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.602561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.604239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:06.606075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 71/146] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:06.611602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:06.772014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265c24-67af-4778-bfdb-c8968fbd0d18 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:06.817031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:06.817687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:06.817989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:06.818259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:06.856261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:06.909366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:06.910977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.042739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:07.048278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.097672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.205221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba610ab-6978-4c4a-ade1-738c8c6e18d4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.247972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.248618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.248893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.249160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.250343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.251790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982f60-a0aa-4e2d-89b6-b9b8b6004013 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.253426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 72/148] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:07.260114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.355636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.407230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d76a0-c46b-487d-ad13-2ca611bafb33 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.415977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3ce6-64c1-4ead-a683-33da37376b32 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.416263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3ce6-64c1-4ead-a683-33da37376b32 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.416522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3ce6-64c1-4ead-a683-33da37376b32 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.419284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 73/149] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:07.427819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.428098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.428371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.449496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.451153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.451440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.451715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.452460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:07.452768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:07.454336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:07.461799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 77/150] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:07.477772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:07.479025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:07.591448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 74/151] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:07.626042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.756575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb112b9-6421-499c-be4b-020d7628bfe5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:07.810301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.814868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:07.815866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:07.816144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:07.816430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:07.833689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:07.839302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:07.840145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:07.840904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 78/152] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:07.851060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:07.882817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:07.974066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffbba5-a97f-462a-85dc-188f0ee4e06a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.022638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.023255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.023530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.023799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.024475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:08.024773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.026165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.034883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 75/153] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:08.041080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.177885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbd117-ef78-41fb-82e4-0e3e953905ff None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.216122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.216819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.217101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.217418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] PATH_INFO: `/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.218605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] RBAC: Authorizing `identity:get_user(user_id=af778c417d2e4c63aa8e2d6e03f3b0d3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.220205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f74ac-7331-4c26-9507-2ec5fc8ff0da None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.221798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 79/154] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:08.228415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.264715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663685-1c98-4fce-b8f1-bbb3aee4672a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.265014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663685-1c98-4fce-b8f1-bbb3aee4672a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.265261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8663685-1c98-4fce-b8f1-bbb3aee4672a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.266633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 80/155] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:08.282593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.283136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.309070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:08.312022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:08.379758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:08.407727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:08.412063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5598922-4077-4bcc-8a2b-4da550c56f81 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.444624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 81/156] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:08.458269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.458904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.459182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.459457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.460571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.462223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.463976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 76/157] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:08.469911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.484118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.623581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c9f31-e265-4c38-8a3f-def9e12723a2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.681410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.682464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.683215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.683471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/af778c417d2e4c63aa8e2d6e03f3b0d3/roles/88b25505d32b467e90329efbee33ec33` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.685806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, user_id=af778c417d2e4c63aa8e2d6e03f3b0d3, role_id=88b25505d32b467e90329efbee33ec33)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:08.687814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:08.705538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 82/158] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:08 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/users/af778c417d2e4c63aa8e2d6e03f3b0d3/roles/88b25505d32b467e90329efbee33ec33 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:08.784218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f10d78-eb8a-46c3-b732-a85fc48e364e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:08.837810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:08.838476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:08.838753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:08.839024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:08.852836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:08.858239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:08.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:08.860063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 77/159] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:08.867749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:08.930304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:08.984502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03fe26-9223-46e0-9723-d10c669a22b6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.021021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.021641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.021936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.022211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.022881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:09.023179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.024540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73b761-603e-4add-ab00-440f11d2374a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.033609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 83/160] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.039444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.055985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.069591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227f8b-897f-49f4-9630-8b0d161693ec None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.069930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227f8b-897f-49f4-9630-8b0d161693ec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.070207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227f8b-897f-49f4-9630-8b0d161693ec None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.071743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 84/161] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:09.077512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.077793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.078090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.102442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:09.103620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:09.202186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0ad5-c1ca-4768-a18e-7cd35d977d10 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.234271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 85/162] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:09.253118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.253719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.253987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.254265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] PATH_INFO: `/v3/users/beb9f8a0db28411a976c62690df62487` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.255922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] RBAC: Authorizing `identity:get_user(user_id=beb9f8a0db28411a976c62690df62487)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.257392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.258994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 78/163] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/users/beb9f8a0db28411a976c62690df62487 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.264678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.284299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.344876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.410559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.431618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380888-31a4-427d-812e-816e708dd8cd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.466752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.467383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.467665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.467923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.479087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b19f6903-5027-4b8d-b2a2-81143412e433 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:09.484361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:09.485239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:09.486047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 79/164] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:09.486706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2595-7cc6-4986-90e2-c27aba3063af None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.486947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2595-7cc6-4986-90e2-c27aba3063af None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.487825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2595-7cc6-4986-90e2-c27aba3063af None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.488564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 80/165] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:09.494276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc372-f74c-439d-8186-b24b14680955 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.494464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.494723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.494998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.513878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:09.515047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:09.555694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.556319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.556596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.556864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.596445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 81/166] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:09.597308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.686900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.724955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35013c-e87c-4958-ba7c-bbf20feb596d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:09.796183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.798343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0156ca-0d54-4519-b6f3-7485f00cf2d5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.801242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:09.802662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.803132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.803618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.804510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:09.805014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:09.806660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:09.822800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 82/167] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:09.824167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:09.875532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:09.994153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 86/168] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:09.995556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef107-bca6-4339-b9c9-a591e4082f99 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:09.995732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef107-bca6-4339-b9c9-a591e4082f99 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:09.995970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef107-bca6-4339-b9c9-a591e4082f99 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:09.997491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 87/169] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:09.998215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef107-bca6-4339-b9c9-a591e4082f99 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.015822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bc145-88b1-455d-b095-08f4852e3d24 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.058688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.066602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.067277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.067552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.067825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.079797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:10.085583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:10.086524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:10.087336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 83/170] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:10.089345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.203922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef107-bca6-4339-b9c9-a591e4082f99 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.258981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7dfe-3d1c-480c-8cea-a72447bcb7d5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.302658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.303300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.303576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.303947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.305085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.306596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f2f1f-4470-4563-b9fb-24aca5e95a8c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.308535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 84/171] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.309882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.310379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.310800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.311615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.312271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.312548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.312816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.313983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.315748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.317655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 88/172] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:09 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.318454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.332219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:10.334273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:10.335732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.411158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.424963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 85/173] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:10.426171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.542175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc73622-5920-4d9a-bfb4-9387823508f7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.561255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3311cb-895a-4d1d-915b-08c4f276bee1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.578556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.579483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.579961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.580444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.581319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:10.581818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.584090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.592999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 89/174] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.594246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.603829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.604446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.604724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.604993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.605720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=beb9f8a0db28411a976c62690df62487) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:10.606061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.607497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea4ce-c406-4b18-9d71-336ce87af964 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.614470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 86/175] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/role_assignments?user.id=beb9f8a0db28411a976c62690df62487&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.616059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e9453-2185-477e-9b39-0fc4c4d34afd None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.616178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e9453-2185-477e-9b39-0fc4c4d34afd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.616413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e9453-2185-477e-9b39-0fc4c4d34afd None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.617630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 87/176] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:10.622608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e9453-2185-477e-9b39-0fc4c4d34afd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.686720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.690742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.737504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f8571-e695-4bff-9eef-aab6e614d9d3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.750066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e9453-2185-477e-9b39-0fc4c4d34afd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.781415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.782015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.782292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.782590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.791402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.792024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.792412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.792680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.804909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:10.809683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:10.810610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:10.811445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 88/177] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:10.812102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:10.863503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.866046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbf130-ee9c-44c9-a046-baf152ef8082 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.945646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18e3-f1c1-4d79-88d9-fb289705da69 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:10.946077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.961986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:10.983767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:10.983981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 90/178] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:10.984157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.984436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.984806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] PATH_INFO: `/v3/users/c57f9edf97cc4625b9968af12791928b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.985086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.985373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.985643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.985985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f9edf97cc4625b9968af12791928b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:10.987443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369f311-7d7c-4710-be08-43acff7e9355 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 89/179] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/users/c57f9edf97cc4625b9968af12791928b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e2ab-c424-4d87-bee2-098454476660 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e2ab-c424-4d87-bee2-098454476660 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e2ab-c424-4d87-bee2-098454476660 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 90/180] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:10.993715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e2ab-c424-4d87-bee2-098454476660 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.009393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:11.010609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:11.081382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 91/181] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:11.082589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.113130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e2ab-c424-4d87-bee2-098454476660 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.148773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.149389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.149663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.149957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.150616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:11.150920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.152303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.160374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 91/182] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.161249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.194863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.200771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e512fd5-609b-4a45-8c47-bf962fecbac8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.210484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.235973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.236613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.236887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.237156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.238289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.240305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e62e37-a193-4595-ad9c-2dab06ca4c02 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.242149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 92/183] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.243057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.243337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.243608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.260722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:11.261894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:11.267971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29ddb-16e3-4ae5-8296-ab86d3568af3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.307448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.308060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.308368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.308768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.330134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 93/184] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:11.342868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.383402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.385640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.434322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.444132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.450976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b800-088a-4989-a562-d7792ad399d5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.485147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.485984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.486269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.486540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.490161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 92/185] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:11.490994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.501008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:11.505855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:11.506755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:11.507545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 94/186] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:11.508294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.591757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2515d-2867-4a8a-ba13-423ae9fa1086 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.606886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac12311-162d-4c56-8acd-adea01fe3309 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.625668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.626340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.626612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.626875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.640179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.640947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.641539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.641636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.641892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.642192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.642907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:11.643405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.643521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 93/187] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.644308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.644899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484960e9-d0a9-4ce5-943d-31c185b8e786 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.646791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.651452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 95/188] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.655269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaed6b-e249-49a5-a664-a91f40fa908f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.655554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaed6b-e249-49a5-a664-a91f40fa908f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.655831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaed6b-e249-49a5-a664-a91f40fa908f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.657308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 96/189] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:11.659480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaed6b-e249-49a5-a664-a91f40fa908f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.687057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.762722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e956bf-c8c7-4358-8cce-830653221644 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.781853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaed6b-e249-49a5-a664-a91f40fa908f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.800102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.801042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.801464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.801732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.802884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.804332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.809935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 94/190] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.809935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.829585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.831242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.831242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.831242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] PATH_INFO: `/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.832489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] RBAC: Authorizing `identity:get_project(project_id=c7a57bcb38a14621b3ed6e3011e9ec39)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.834282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.835887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 97/191] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/projects/c7a57bcb38a14621b3ed6e3011e9ec39 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.836646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:11.890183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.921869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a45c-fc83-4ea2-8d24-343908469d1c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.939006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:11.952111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f271-a773-48a9-b9fe-4d53f5327e2b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:11.956293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.956896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.957174 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.957469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.958198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:11.958515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:11.960345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16f31-8352-4833-bf65-76c80adaf63b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:11.969704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 95/192] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:11.970908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.971194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.971644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.987924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:11.988447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:11.988553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:11.989324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:11.989594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:11.990178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:12.060994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.062488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.065975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 96/193] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:12.070295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.128828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.158492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.167777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9026f-0c3a-4611-b8ae-46a9f0e046a9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.172161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 98/194] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:12.172980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.204426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.205124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.205504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.205778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.206444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.207871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.228311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 97/195] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:12 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:12.228311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.278265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dce869-2387-459d-bd22-edf9de9e6812 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.319890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.321035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.321315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.321739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.322507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=c7a57bcb38a14621b3ed6e3011e9ec39, user.id=c57f9edf97cc4625b9968af12791928b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:12.322853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.324317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.330750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 99/196] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/role_assignments?user.id=c57f9edf97cc4625b9968af12791928b&scope.project.id=c7a57bcb38a14621b3ed6e3011e9ec39&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.339088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.360355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b32b2-3019-4432-b4c3-6500c675fa96 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.388176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.418924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.419928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.419928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.420215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.421367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.423051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.425043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 98/197] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.425660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.435103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.502032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c20-4a4d-42d5-94a0-d003eab74cbd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.552820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.553468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.553743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.554034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.559768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c86d5-5e18-4f4b-a433-b4bc4b03a743 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.571768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:12.577006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:12.577873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:12.578729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:12.583714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 100/198] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:12.584606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.601793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.602467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.602747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.603013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.604126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.605564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.607392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 99/199] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.608082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.681712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.708113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f58e-235f-4a0d-8072-0f703f772990 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.723046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.735340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a183f-b418-4a4a-912b-fa1f448d8dd3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.748229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.748842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.749371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.749650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.771767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.772380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.772654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.772924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.773594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:12.773893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.775294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.784215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 100/200] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.784872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:12.846336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.848625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.898250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc1f0-969c-4ece-ae79-05a03a902b90 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:12.915933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:12.938290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:12.938991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:12.939368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:12.939767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:12.940639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=217c5c7b79b248f48327693779b2694f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:12.941043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:12.942907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:12.952510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 101/201] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/role_assignments?user.id=217c5c7b79b248f48327693779b2694f&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:12.953598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.012146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 101/202] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:13.017871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.050291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.151427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3133-0583-424a-a2a9-419ae9d32951 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.183363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496c3fe-4e89-4c81-9c6e-0c654be6863b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.213317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.213880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.214184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.214458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] PATH_INFO: `/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.215622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] RBAC: Authorizing `identity:get_user(user_id=af778c417d2e4c63aa8e2d6e03f3b0d3)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.217080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.218716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 102/203] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:12 2022] GET /identity/v3/users/af778c417d2e4c63aa8e2d6e03f3b0d3 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:13.225798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.226461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.226735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.227002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.228870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.238467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.240063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.244135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 102/204] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:13.248821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.295300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.346530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f8eaa-b608-4159-9745-c0e6643b9745 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.414341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.423095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.424367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.424833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.425289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.434985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd785c3-773b-4eba-b795-db06dcdadd82 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.487600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.488131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.488411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.489215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.489964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=217c5c7b79b248f48327693779b2694f) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:13.490271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.491806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.497745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 103/205] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/role_assignments?user.id=217c5c7b79b248f48327693779b2694f&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:13.569089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.570626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.628635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:13.684394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 103/206] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:13.690398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:13.814762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cb918-e443-4f50-958f-437ab4edda55 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:13.858779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:13.859765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:13.860254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:13.860712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:13.866553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:13.868195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8324-4135-4ece-ac7f-d94c4fb0f228 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:13.870026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 104/207] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:13.875953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:14.017648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301f1e-8a19-4db4-8da6-8d556f745235 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:14.069508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:14.070060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.070335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.070597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.071318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, scope.project.id=8679ca462ab94d648d02fc0dff98697d, user.id=af778c417d2e4c63aa8e2d6e03f3b0d3) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:14.071612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:14.073038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb31e-bf78-461a-a575-2723e1186c25 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:14.082276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 104/208] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:13 2022] GET /identity/v3/role_assignments?user.id=af778c417d2e4c63aa8e2d6e03f3b0d3&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=88b25505d32b467e90329efbee33ec33 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:14.560893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4324e-96eb-495c-abb1-9c82bd058864 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.561407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4324e-96eb-495c-abb1-9c82bd058864 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.561407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4324e-96eb-495c-abb1-9c82bd058864 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.562819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 105/209] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:14.568761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855f9cf-ffed-4c2a-8c25-8409cca965d3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.569223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855f9cf-ffed-4c2a-8c25-8409cca965d3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.569311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855f9cf-ffed-4c2a-8c25-8409cca965d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.591751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5855f9cf-ffed-4c2a-8c25-8409cca965d3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:14.593240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5855f9cf-ffed-4c2a-8c25-8409cca965d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:14.603472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:14.681371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 105/210] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:14.703551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4324e-96eb-495c-abb1-9c82bd058864 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:14.721366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:14.770624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afe0c-b90e-4367-ae26-7b8ae628100b None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.771249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afe0c-b90e-4367-ae26-7b8ae628100b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.771737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afe0c-b90e-4367-ae26-7b8ae628100b None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.773292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 106/211] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:14.778424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.779028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.779856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.804133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:14.806423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:14.835073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4324e-96eb-495c-abb1-9c82bd058864 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:14.880611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 107/212] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:14.891739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:14.892659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:14.893129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:14.893844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:14.906012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:14.906838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:14.912617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:14.913526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:14.914382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:14.916807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 106/213] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:14.923061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:14.996384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.010303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.031359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00466a-02bf-496e-b35e-e1f7ba5d8a2e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.034761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52aaf-ebca-4f9a-b327-9419bdddd3c8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.071265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.072484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.073325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.074091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.075474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.077320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.077607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.078242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.078516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.078785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.079442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:15.079740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.085452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.085965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 108/214] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:15.087414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.101744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 107/215] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:15.103551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.219152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78119-8eeb-44cd-94d7-2ef4eadabc83 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.219815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc403d-cac6-4129-933e-26bf526e8e19 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.255499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.255847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.256486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.256762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.257031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] PATH_INFO: `/v3/users/3fb8c861ad99433e86ec66f8242127b7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.257281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.257749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.258225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.258947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.259353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.260999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa15f24-ced4-4613-827c-6a31b4f750aa None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.272773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.274394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] RBAC: Authorizing `identity:get_user(user_id=3fb8c861ad99433e86ec66f8242127b7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.276300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.282939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 108/216] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/users/3fb8c861ad99433e86ec66f8242127b7 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:15.284551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.294239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 109/217] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:15 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:15.420358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b781-c3c3-4dfd-9127-27bf0ff1071a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.421537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71167f-dc85-4857-8a9a-483efcb3e170 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.421821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71167f-dc85-4857-8a9a-483efcb3e170 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.422119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71167f-dc85-4857-8a9a-483efcb3e170 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.423617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 110/218] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:15.429411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.429678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.429969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.449599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:15.450444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:15.466206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.466833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.467106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.467377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.543362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.548516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 111/219] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:15.555849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.557314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.571403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.687683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 109/220] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:15.693074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.719660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a832fe7-4676-4afa-8dd7-6b6f7d7fdb8d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.763111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.763882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.764168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.764434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.769278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.780239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:15.786595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:15.787478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:15.788258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 112/221] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:15.794419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.814135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:15.823469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec611e-3e87-43b2-8010-0a1946f5ce0c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.870827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.871467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.871775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.872070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.873534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.875692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56778a33-8dbe-4c71-b287-075f1fc91887 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.878057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 110/222] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:15.880127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4afd7-e5ce-4ec2-97b9-13df3ebe6f50 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.880413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4afd7-e5ce-4ec2-97b9-13df3ebe6f50 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.880682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4afd7-e5ce-4ec2-97b9-13df3ebe6f50 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.881959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 111/223] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:15.887271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4afd7-e5ce-4ec2-97b9-13df3ebe6f50 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:15.916846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98273e-6d2b-4486-8fca-e8ca60869f59 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:15.957657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:15.958499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.958899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.959581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.960612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:15.961008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:15.962965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb4fc-d283-45a3-a90e-a562c1bce23b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:15.975425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 113/224] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:15.976677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:15.977054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:15.977416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:15.999397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:16.000888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:16.012562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4afd7-e5ce-4ec2-97b9-13df3ebe6f50 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.050993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.059807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.060484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.060823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.061149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.061955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=3fb8c861ad99433e86ec66f8242127b7) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:16.062350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.064274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.072329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 112/225] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:15 2022] GET /identity/v3/role_assignments?user.id=3fb8c861ad99433e86ec66f8242127b7&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.073502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.092963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 114/226] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:16.128126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.173955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.227573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee629-1605-4db4-9efa-ca9e3e58bdd1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.264447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.265610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.266097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.266544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.267889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.269791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.274702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 113/227] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.287040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.391362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0a3ab-08dd-4df1-8ca2-7ba9a7a46bd0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.462440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.463243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.463882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.464148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.464413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.474554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce94fb-0dc4-46a6-b323-d81f5c4e103b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.485653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:16.492585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:16.493601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:16.494422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:16.495293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 115/228] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:16.501810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.539099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.539729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.540002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.540269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.542437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.545301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.554036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 114/229] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.556071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.573195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.680525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00d181-a1b7-453d-84a2-8d3182971a08 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.732156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6ff9-2d90-42c4-8533-00c2ae2e5367 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.750283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.751249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.751742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.752153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.752836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:16.753135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.755096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.774157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 116/230] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.779444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.800228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.800891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.801239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.801506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/217c5c7b79b248f48327693779b2694f/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.805207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, user_id=217c5c7b79b248f48327693779b2694f, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.807552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.856729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 115/231] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:16 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/217c5c7b79b248f48327693779b2694f/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:16.906902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd6018-17cc-4db5-ac4c-fc0cfd78d332 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:16.910262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:16.945249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:16.946217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:16.946627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:16.947064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:16.948317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:16.950007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:16.951731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 117/232] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:16.957658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:16.983868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:17.073972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82f266-60dd-45cc-9ba1-2d2e57ee4364 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.115767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.116652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.117086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.117497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.118791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.120493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de16fc-2f64-43a4-9a23-58578d20d037 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.122734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 116/233] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:16 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:17.128458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:17.235143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585693-83a9-4ffa-b71e-686645cf0b00 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:17.271929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:17.272837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.273309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.273712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/217c5c7b79b248f48327693779b2694f/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.275990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, user_id=217c5c7b79b248f48327693779b2694f, role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:17.277554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414330c8-6833-4193-9b3e-1c78ac43c37f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:17.296809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 118/234] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:17 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/217c5c7b79b248f48327693779b2694f/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:17.880314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd12e3-d5e3-4cbf-97df-55f2ee9efc18 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.880820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd12e3-d5e3-4cbf-97df-55f2ee9efc18 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.880893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd12e3-d5e3-4cbf-97df-55f2ee9efc18 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.882353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 117/235] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:17.887494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d89b-dd46-4b6f-93d2-0ca940a56fa9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:17.887912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d89b-dd46-4b6f-93d2-0ca940a56fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:17.888099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507d89b-dd46-4b6f-93d2-0ca940a56fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:17.914261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3507d89b-dd46-4b6f-93d2-0ca940a56fa9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:17.915803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3507d89b-dd46-4b6f-93d2-0ca940a56fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:17.944603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.010019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 119/236] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:18.045452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd12e3-d5e3-4cbf-97df-55f2ee9efc18 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.168065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.183260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd12e3-d5e3-4cbf-97df-55f2ee9efc18 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.232898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.233525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.233799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.234083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.247952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:18.252656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:18.253514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:18.254883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 118/237] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:18.260155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2215e-6f87-4902-a91f-58cd6d2f1754 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.260285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.260483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2215e-6f87-4902-a91f-58cd6d2f1754 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.260684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2215e-6f87-4902-a91f-58cd6d2f1754 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.263391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 120/238] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:18.271201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51668-25dd-469b-ace3-948dc6e8cd6f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.271481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51668-25dd-469b-ace3-948dc6e8cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.271753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51668-25dd-469b-ace3-948dc6e8cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.299994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-27f51668-25dd-469b-ace3-948dc6e8cd6f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:18.301228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-27f51668-25dd-469b-ace3-948dc6e8cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:18.369746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f51ca6-5d84-471e-b1cb-3688eb26d847 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.388517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 121/239] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:18.395191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d72d-0625-4ce4-95d2-bc988596a424 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.395470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d72d-0625-4ce4-95d2-bc988596a424 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.395741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d72d-0625-4ce4-95d2-bc988596a424 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.398433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 122/240] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:18.402384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.402656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.402921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.420445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.420984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.421258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.421523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.422316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:18.423141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.424832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.427852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:18.429001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:18.434941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 119/241] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:18.435817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.457875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.512361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 123/242] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:18.513613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.536159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.588519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d71675-9e3e-4b8c-9e41-cce71381fdbb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.633644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951227b-64e6-4e94-ad1d-0fec6f51cfd4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.635018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.635913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.636201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.636474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.658160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:18.667380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:18.668344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:18.669138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:18.674101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 120/243] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:18.675503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.685348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.686461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.686970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.687479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] PATH_INFO: `/v3/users/e681407439b14e03a226421670ca8ccb` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.702590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e681407439b14e03a226421670ca8ccb)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.704600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.706602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 124/244] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/users/e681407439b14e03a226421670ca8ccb => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.708244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.768209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.793632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:18.810697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9fde5-6a30-46e5-8110-f2ed1cd99cbb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.819695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d8ce-247b-4252-bc43-4548c3bca0d8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.845436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.846097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.846377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.846646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.847751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.849242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.855451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 121/245] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.855451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.861768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:18.862658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:18.863167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:18.864152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:18.865017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:18.865557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:18.867204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:18.876323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 125/246] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:18.877327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:18.971322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96ea97-5acb-4cd6-acbf-2bdc09dfa58a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:18.983509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ab7a-eea7-48b9-a103-bf25797ef542 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.007367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.007971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.008249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.008519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.017365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.023315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.024185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.024651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.025167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.026037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.027751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.038737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.053443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 126/247] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:18 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:19.063500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.083254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.084709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.245652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 122/248] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:19.251819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.279186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662c14-422d-4390-be0d-425d0f0bcd4f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.314998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.326920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.328570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.328570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.328570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] PATH_INFO: `/v3/users/3fb8c861ad99433e86ec66f8242127b7` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.330066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb8c861ad99433e86ec66f8242127b7)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.331757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.338010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 127/249] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/users/3fb8c861ad99433e86ec66f8242127b7 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.341005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.399957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d6a85-3065-4411-8e09-ab189a0b288b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.424169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.453746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.454787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.455472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.455974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.458771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.460222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.462194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 123/250] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.469943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.490212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fd5a6-4f14-49ed-8148-bca310074831 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.537242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.537811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.538945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.539336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.540501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.541974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304ad92-283c-4670-a473-7535ee5cd539 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.548627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 128/251] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.550283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fbb8-ea8a-40fe-b76b-314bad47611a None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.550437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fbb8-ea8a-40fe-b76b-314bad47611a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.550715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1fbb8-ea8a-40fe-b76b-314bad47611a None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.552516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 129/252] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:19.553273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1fbb8-ea8a-40fe-b76b-314bad47611a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.595766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef545ce1-ae5b-42cf-bf51-4f7586915953 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.605086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.640802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.641409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.641685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.641981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.642709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=e681407439b14e03a226421670ca8ccb) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:19.643013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.645321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24359e-3795-4b86-b6e0-6e14a2342f26 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.652034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 124/253] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/role_assignments?user.id=e681407439b14e03a226421670ca8ccb&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=88b25505d32b467e90329efbee33ec33 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:19.658158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149444f5-e944-4352-bf97-39937b34413e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.658158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149444f5-e944-4352-bf97-39937b34413e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.658158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149444f5-e944-4352-bf97-39937b34413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.674049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-149444f5-e944-4352-bf97-39937b34413e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:19.675269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-149444f5-e944-4352-bf97-39937b34413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:19.698798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1fbb8-ea8a-40fe-b76b-314bad47611a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:19.743673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:19.756805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:19.757485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.757761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.758060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/3fb8c861ad99433e86ec66f8242127b7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.763201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, user_id=3fb8c861ad99433e86ec66f8242127b7, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:19.764669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:19.765037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 125/254] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:19.766345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda153-7209-429f-bf6b-4e30e728ad38 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.766630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda153-7209-429f-bf6b-4e30e728ad38 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.766935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffda153-7209-429f-bf6b-4e30e728ad38 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.768357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 126/255] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:19.773893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:19.774168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:19.774430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:19.788975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 130/256] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:19 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/3fb8c861ad99433e86ec66f8242127b7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:19.799927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:19.801289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:19.831558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:19.936344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 127/257] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:19.982501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.006556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c2b9e-7351-48aa-8cc2-0d023a1a61b9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.049089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.049665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.049978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.050252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.061845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:20.068466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:20.069555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:20.070462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:20.071989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 131/258] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:20.077136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.137452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.236407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00aadc-99ee-4d0c-8917-10125fbdf4a7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.240085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1fb9-3901-4a0f-bdfd-4165cd1c45b6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.296527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.297564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.298232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.298905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.299855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:20.300362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.302123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.324547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 132/259] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:20.326617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e227-a967-45c3-88de-d4572272588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.327272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e227-a967-45c3-88de-d4572272588d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.327550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e227-a967-45c3-88de-d4572272588d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.327816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e227-a967-45c3-88de-d4572272588d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.331609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.343306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e227-a967-45c3-88de-d4572272588d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3621e227-a967-45c3-88de-d4572272588d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:20.348144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:20.349019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:20.350321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 128/260] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:20.358746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e227-a967-45c3-88de-d4572272588d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.530069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a76a-cf75-4c1a-94b0-bb8ed24aa21b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.563110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.587852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.588801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.589084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.589354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.594684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.596154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.598211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 133/261] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:20.603448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.634347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.687961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e227-a967-45c3-88de-d4572272588d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.743734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3703ef-5b83-4719-a415-1895454b0fb2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:20.763517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.764125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.764399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.764668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.765324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:20.765625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.767021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.784352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 129/262] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:20.788937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:20.810791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:20.811922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:20.812204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:20.814208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:20.914257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:20.936642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:20.938151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:20.990096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936346b-d49f-43e2-95f6-7b3c27638530 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.072973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.073517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.073792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.074085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] PATH_INFO: `/v3/users/217c5c7b79b248f48327693779b2694f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.081852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] RBAC: Authorizing `identity:get_user(user_id=217c5c7b79b248f48327693779b2694f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.083868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.085823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 130/263] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/users/217c5c7b79b248f48327693779b2694f => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:21.092840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.125517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.152771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 134/264] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:21.162893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.232293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50956b-322c-44c1-95ba-89114681bb0f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.279177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.279797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.280080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.280349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.318344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.343286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a972a0-ab6e-4570-a877-65ab08d43139 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.396230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.397714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.406608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.407258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.407537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.407807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.408957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.410986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.412625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 135/265] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:21.429129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.439838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.576125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 131/266] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:21.590864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.617138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5aaa-8585-4840-b74f-21af7b919512 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.678699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.679318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.679595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.679862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.680591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=217c5c7b79b248f48327693779b2694f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:21.680895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.682357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.688715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 136/267] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/role_assignments?user.id=217c5c7b79b248f48327693779b2694f&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:21.756938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201b688-e912-4ced-81db-ee4a56dac4a0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:21.798303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.831742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:21.832459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:21.832737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:21.833004 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:21.838674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:21.840168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ae19-37b4-4f9c-82db-70be6bba600d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:21.841945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 132/268] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:21.848056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:21.880093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:21.989706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e3943-e6b5-4363-8618-c000299dbb87 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.026238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.026434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a15-8c1a-4e4b-a886-1aca86b90053 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.026848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a15-8c1a-4e4b-a886-1aca86b90053 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.026950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a15-8c1a-4e4b-a886-1aca86b90053 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.027828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.028220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 133/269] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:22.028554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.029016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.030038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=217c5c7b79b248f48327693779b2694f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:22.030555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.032209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.035762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.036047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.036317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.040781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 137/270] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:21 2022] GET /identity/v3/role_assignments?user.id=217c5c7b79b248f48327693779b2694f&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:22.062521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:22.063741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:22.155913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 134/271] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:22.188796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.302861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.330691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8855d-bea0-493c-ac2c-81029abfb5e5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.366216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.367693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.368321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.369071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.381757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b19a43c2-af27-4c85-be3a-2305ff39ec9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:22.387379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:22.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.389061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:22.391342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 138/272] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:22.398483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.438524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9e527-c086-4df5-b963-1733ade408be None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.439103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9e527-c086-4df5-b963-1733ade408be None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.439671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9e527-c086-4df5-b963-1733ade408be None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.441208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 139/273] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:22.446553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.447069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.447561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.468307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:22.469986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:22.502356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ab6b9-779a-4bfc-af46-4cd883b2c2a0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.521144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.542385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.543112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.543396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.543665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.544431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:22.544742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.546141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.547025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 140/274] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:22.555823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 135/275] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:22.561289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.573671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.672229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.679082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170ba7-6e1b-4ea8-a636-f31b1659ee68 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.709155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93144e-2670-4401-86ad-93c2cb89e772 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.715059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.715721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.715996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.716263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.727953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-aab535b7-5251-4601-8a47-1c160c6ddcd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:22.733171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:22.734086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:22.734901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 136/276] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:22.735551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219c31-2496-4c40-8217-e88f1bcaa568 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.736222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219c31-2496-4c40-8217-e88f1bcaa568 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.736222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f219c31-2496-4c40-8217-e88f1bcaa568 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.741544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 137/277] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:22.741544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f219c31-2496-4c40-8217-e88f1bcaa568 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.752808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.753615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.753741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.754533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] PATH_INFO: `/v3/users/afd8ef4822af44caa19e53196ffdcf88` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.769512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] RBAC: Authorizing `identity:get_user(user_id=afd8ef4822af44caa19e53196ffdcf88)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.771156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac829d36-fdb6-4881-b2e1-9370b3586cae None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.773011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 141/278] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/users/afd8ef4822af44caa19e53196ffdcf88 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:22.774177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.774454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.774722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.790198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.793498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:22.794694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:22.854003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f219c31-2496-4c40-8217-e88f1bcaa568 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:22.861850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 142/279] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:22.862950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.896799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:22.897408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.897688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.897989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.898655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:22.898956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:22.900323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeca59-c0a4-4abc-875a-287194c5afd4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:22.908343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 138/280] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:22.909555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d22a-14d8-4634-a7e3-da1c6442026b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:22.909842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d22a-14d8-4634-a7e3-da1c6442026b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:22.910670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d22a-14d8-4634-a7e3-da1c6442026b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:22.912007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 139/281] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:22.915118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d22a-14d8-4634-a7e3-da1c6442026b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:22.930211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:22.973780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d261b-b565-4e6b-9e45-79af19c1d0a7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.008179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.008780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.009055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.009323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.010068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, user.id=afd8ef4822af44caa19e53196ffdcf88, scope.system=all) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:23.010372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.011808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.014757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d22a-14d8-4634-a7e3-da1c6442026b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.016232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.016796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 143/282] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/role_assignments?user.id=afd8ef4822af44caa19e53196ffdcf88&scope.system=all&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.017516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.069466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.070235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.070427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.070695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.071891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.073719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539074-9690-4266-99c1-6f92bc6a9f6f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.080332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 140/283] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.080332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb95ad-226a-4674-b39a-651198672dde None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.080332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb95ad-226a-4674-b39a-651198672dde None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.080332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb95ad-226a-4674-b39a-651198672dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.096688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-35fb95ad-226a-4674-b39a-651198672dde None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:23.098669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-35fb95ad-226a-4674-b39a-651198672dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:23.136440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21005-14e5-40f8-94c4-15e84c1d0280 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.159186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.174577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 141/284] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:23.180227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.180856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.181128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.181394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] PATH_INFO: `/v3/users/3fb8c861ad99433e86ec66f8242127b7` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.182541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb8c861ad99433e86ec66f8242127b7)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.182708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb95ad-226a-4674-b39a-651198672dde None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.184047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.185735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 144/285] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/users/3fb8c861ad99433e86ec66f8242127b7 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.190917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.291494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.294504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb95ad-226a-4674-b39a-651198672dde None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.294623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1ae12-fd17-45cc-964b-4d7c52c23036 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.331107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.331304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.331710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.331815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.332534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.332640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.332787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.332875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.333509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.334957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.357857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 142/286] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:23 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:23.358520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.418099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.438977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.440877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.482461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af695a1-4f9f-4b47-8f93-8baff56a7517 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.524827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.525453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.525729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.526025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.542225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:23.548410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:23.549519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:23.550501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 143/287] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:23.557252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.579134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 145/288] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:23.581073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.586215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.690055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f455b13-5620-47a4-8f17-aec6d6b37b33 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.697149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.714614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b782-a2b9-475a-9623-a8e3eecad63a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.736828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.737433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.737704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.739040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.739040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:23.739040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.740352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.749300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 144/289] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:23.755496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.755780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.756503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.756923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.757332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.758617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.760233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.762107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 146/290] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:23.767946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:23.861379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:23.888215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e701dc2-aabb-4540-bce7-724ef78e89a6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.898114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57087ecc-869c-4e57-8b5e-ddb271bd682c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:23.943244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.944086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.944520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.944937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.945841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=3fb8c861ad99433e86ec66f8242127b7) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:23.946512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.948234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.959258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 147/291] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/role_assignments?user.id=3fb8c861ad99433e86ec66f8242127b7&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:23.968496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:23.969395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:23.969843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:23.970268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] PATH_INFO: `/v3/users/e681407439b14e03a226421670ca8ccb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:23.972092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] RBAC: Authorizing `identity:get_user(user_id=e681407439b14e03a226421670ca8ccb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:23.973653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:23.975516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 145/292] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/users/e681407439b14e03a226421670ca8ccb => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:23.981584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.014324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:24.125318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee0acf-9843-4843-ba3f-a01a2ef1f974 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.186290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.186945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.187221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.187489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.188654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:24.190112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f7ad-5aa8-46fb-9803-9c5862564d07 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:24.192205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 148/293] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:23 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:24.198651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:24.346645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e4c2f-3265-41c0-85fa-4e1704a56944 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:24.382253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:24.382809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:24.383089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:24.383361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/e681407439b14e03a226421670ca8ccb/roles/88b25505d32b467e90329efbee33ec33` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:24.385271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, user_id=e681407439b14e03a226421670ca8ccb, role_id=88b25505d32b467e90329efbee33ec33)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:24.386734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f341a4a-0e03-43a5-870d-cf11705e2795 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:24.402899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 146/294] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:07:24 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/users/e681407439b14e03a226421670ca8ccb/roles/88b25505d32b467e90329efbee33ec33 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:25.167429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334436-7e82-40c8-9407-549ae475dd2a None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.167768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334436-7e82-40c8-9407-549ae475dd2a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.167946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334436-7e82-40c8-9407-549ae475dd2a None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.169386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 149/295] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:25.174735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.175240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.175786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.188954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.195183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:25.196585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:25.264314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 147/296] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:25.287549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334436-7e82-40c8-9407-549ae475dd2a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.375078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.391522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334436-7e82-40c8-9407-549ae475dd2a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.427135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.428099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.428572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.429030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.439773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:25.444889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:25.445781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:25.446605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:25.448796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 150/297] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:25.454818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.555900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dc46e-8438-41d3-bbe0-9494cdda50ef None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.590596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.591582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.592059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.592526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.593417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:25.593932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.595602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2243f-2ddc-45bc-bb85-966d081c8061 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.602287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.606739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 148/298] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:25.612790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.719083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec406-4bef-45e2-a042-a777905fdf7a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.747430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a711c6-d8b0-41e9-8b75-3e0f2e2f1a62 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.748042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a711c6-d8b0-41e9-8b75-3e0f2e2f1a62 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.748512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a711c6-d8b0-41e9-8b75-3e0f2e2f1a62 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.750305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 149/299] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:25.753580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.754975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.755463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.755565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090081d7-8698-4ffb-b159-cd62c73da273 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.755758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090081d7-8698-4ffb-b159-cd62c73da273 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.756028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090081d7-8698-4ffb-b159-cd62c73da273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.756439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] PATH_INFO: `/v3/users/afd8ef4822af44caa19e53196ffdcf88` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.757818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] RBAC: Authorizing `identity:get_user(user_id=afd8ef4822af44caa19e53196ffdcf88)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.759403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.761151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 151/300] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/users/afd8ef4822af44caa19e53196ffdcf88 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:25.767867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.779037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-090081d7-8698-4ffb-b159-cd62c73da273 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:25.780506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-090081d7-8698-4ffb-b159-cd62c73da273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:25.786234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:25.867136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 150/301] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:25.869302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84160862-83c4-4ec5-bcea-cde7fdb32e06 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.869927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84160862-83c4-4ec5-bcea-cde7fdb32e06 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.870449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84160862-83c4-4ec5-bcea-cde7fdb32e06 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.872459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 151/302] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:25.883663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.884162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.884314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a130bb0-c497-4e2a-8c4d-e91d161fe2cf None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:25.884751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.905671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:25.906885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:25.921139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:25.921784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:25.922083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:25.922358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] PATH_INFO: `/v3/system/users/afd8ef4822af44caa19e53196ffdcf88/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:25.923745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afd8ef4822af44caa19e53196ffdcf88, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:25.925093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:25.935263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 152/303] 10.222.0.30 () {58 vars in 1334 bytes} [Sun Aug 7 18:07:25 2022] PUT /identity/v3/system/users/afd8ef4822af44caa19e53196ffdcf88/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:07:25.946145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:25.996627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 152/304] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:26.018431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.050301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.071856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b734-2a8a-4061-a79f-15aa78c46abf None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.098181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.129935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.129935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.129935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.129935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.142887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:26.147551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa282d7-f6fd-4a4d-94ef-4128dcb227d2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:26.150978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:26.151957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:26.152737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 153/305] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:26.159290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.197176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.198965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.199244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.199511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.201252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.202806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.204610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 153/306] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:26.210801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.277618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606c12-c82a-44d3-8b89-3455c688dab1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.314854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.316267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.317458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.317757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791920-9e7e-4b78-baec-ab5d4719aeae None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.319007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.320405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:26.320919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.322981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.329474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.335356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 154/307] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:26.343398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.350683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.363906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.365440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.366052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.366504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] PATH_INFO: `/v3/groups` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.367621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.369623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62d8c-98b6-451d-bd4c-e45dae50756e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.392628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 154/308] 10.222.0.30 () {60 vars in 1134 bytes} [Sun Aug 7 18:07:26 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:07:26.470320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfff38a-41a1-48a8-a9ac-25887bd72fbe None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.513022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.514102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.514583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.515081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] PATH_INFO: `/v3/users/8b10d87b0e8d4612a7da1a6c885eed51` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.530477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316b9-fcf3-40c6-987f-b69786503839 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.531167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316b9-fcf3-40c6-987f-b69786503839 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.531695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971316b9-fcf3-40c6-987f-b69786503839 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.533141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] RBAC: Authorizing `identity:get_user(user_id=8b10d87b0e8d4612a7da1a6c885eed51)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.534086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 155/309] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:26.534663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.537044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 155/310] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/users/8b10d87b0e8d4612a7da1a6c885eed51 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.545954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.546133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.546133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.546133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.564905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:26.566116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:26.613319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.647380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 156/311] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:26.668725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae86b-fc90-497a-942c-8ef215770a13 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.670013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.713762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.715191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.715891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.716341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.717934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, user.id=8b10d87b0e8d4612a7da1a6c885eed51, scope.system=all) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:26.718410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:26.720750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:26.727904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 156/312] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/role_assignments?user.id=8b10d87b0e8d4612a7da1a6c885eed51&scope.system=all&role.id=88b25505d32b467e90329efbee33ec33 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:26.786315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474d9c-2229-42d6-9301-a238612fd6e5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.806830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:26.827447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:26.828378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:26.828804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:26.829227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:26.842656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:26.849366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:26.850605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:26.851609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:26.853695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 157/313] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:26.859834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:26.968921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdc2d6-d5df-49d6-8036-258437d57f6d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:26.994874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.007928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.008534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.008812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.009082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.009748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:27.010081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.011452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.020992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 157/314] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.027004 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.141934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0a16-4c06-493c-98cd-fcd79524261e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.177738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.178680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.179134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.179578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] PATH_INFO: `/v3/users/e681407439b14e03a226421670ca8ccb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.180973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] RBAC: Authorizing `identity:get_user(user_id=e681407439b14e03a226421670ca8ccb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.182628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.184379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 158/315] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/users/e681407439b14e03a226421670ca8ccb => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.190251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.300404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aefb21-6740-4c62-9710-1421610f8dfb None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.335346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.335985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.336194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.336464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.388423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.406734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.408109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.510061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 158/316] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:27.519224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.570961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.626323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a778e-935f-48d6-8861-d0bae3f18e08 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.661894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.662521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.662801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.663070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.664240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.665687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2842-fbe1-4261-9a66-be20eea9bb49 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.667621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 159/317] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:27.673434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:27.763104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:27.781580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f0f6c-946f-49e6-a658-2696791e3e92 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:27.817225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:27.817833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:27.818203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:27.818470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:27.819184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, scope.project.id=fe9c2c8e272f4858bafa17d114954723, user.id=e681407439b14e03a226421670ca8ccb) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:27.819488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:27.820913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b012-ebaa-49a3-896f-00297615a687 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:27.827194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 159/318] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:27 2022] GET /identity/v3/role_assignments?user.id=e681407439b14e03a226421670ca8ccb&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=88b25505d32b467e90329efbee33ec33 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:28.002326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757715-7b0f-4176-8b1f-ec793d1ad01b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.002564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757715-7b0f-4176-8b1f-ec793d1ad01b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.002793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757715-7b0f-4176-8b1f-ec793d1ad01b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.004666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 160/319] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:28.010191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.010472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.010741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.032397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:28.033576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:28.104440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 160/320] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:28.126912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757715-7b0f-4176-8b1f-ec793d1ad01b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.229195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757715-7b0f-4176-8b1f-ec793d1ad01b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.242226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.264728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.265283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.265560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.265830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.276862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:28.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:28.282588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:28.283403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:28.287777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 161/321] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:28.288772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.367286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.391869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf9e4-af1a-4a77-b050-7c492481fdcd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.426849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.427670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.428083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.428488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.429323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:28.429757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.431325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.440327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 161/322] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:28.446221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.547886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc88f-1322-4c9c-af15-732f8835ea7d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.582792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.583417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.583692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.583964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] PATH_INFO: `/v3/users/afd8ef4822af44caa19e53196ffdcf88` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.585055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] RBAC: Authorizing `identity:get_user(user_id=afd8ef4822af44caa19e53196ffdcf88)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.586527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907403-72e3-4dbb-8684-71a8c7ed206c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.588233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 162/323] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/users/afd8ef4822af44caa19e53196ffdcf88 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:28.593777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.629705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b37b5-8ea6-43ec-ac23-8318c7977618 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.630743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b37b5-8ea6-43ec-ac23-8318c7977618 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.630743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b37b5-8ea6-43ec-ac23-8318c7977618 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.631727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 163/324] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:28.636318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.636597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.636863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.655229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:28.656405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:28.693182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.698960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985418-0104-4d34-bd5b-7d2f32fad8bf None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.728513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 164/325] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:28.734444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.735043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.735317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.735583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.736300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] RBAC: Adding query filter params (role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, user.id=afd8ef4822af44caa19e53196ffdcf88, scope.system=all) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:28.736602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.738134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a06a53-4e7f-453e-8071-11a94198d51f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.744635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.750755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.752193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 162/326] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/role_assignments?user.id=afd8ef4822af44caa19e53196ffdcf88&scope.system=all&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:28.848003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12256-3df8-4ff8-b73e-4925734e1a29 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.848345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12256-3df8-4ff8-b73e-4925734e1a29 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.849128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12256-3df8-4ff8-b73e-4925734e1a29 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.851031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 163/327] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:28.856486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.856780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.857031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.861044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f56d1-501e-4a54-b332-cb9be0f46e3a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:28.876548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:28.877761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:28.912670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:28.913927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:28.913927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:28.914128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:28.915062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:28.916491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:28.918589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 165/328] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:28.924447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:28.959281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 164/329] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:28.971674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:28.981702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:29.034229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30af23-e0b6-48e1-9932-da6936ce2b8a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:29.067664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:29.068257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:29.068533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:29.068797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:29.069401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:29.070835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:29.084398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e7846-6912-4b2e-bbd4-65c958be34a5 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:29.085843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 166/330] 10.222.0.30 () {60 vars in 1134 bytes} [Sun Aug 7 18:07:28 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:07:29.112721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:29.121391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:29.122078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:29.122356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:29.122626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:29.133854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:29.138827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:29.139760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:29.140569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 165/331] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:29.146916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:29.246979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:29.252125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f8db8-5d76-467b-a29c-5de1a3c2d7c2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:29.288006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:29.288603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:29.288886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:29.289151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:29.289805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:29.290152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:29.291508 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:29.299658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 167/332] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:29.305359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:29.414308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f6e1-8417-49ac-9147-1d27a4c1eb51 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:29.451302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:29.451940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:29.452215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:29.452481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] PATH_INFO: `/v3/users/8b10d87b0e8d4612a7da1a6c885eed51` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:29.453613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] RBAC: Authorizing `identity:get_user(user_id=8b10d87b0e8d4612a7da1a6c885eed51)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:29.455106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d5e07-2084-4e32-8b39-2cfdb39620c9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:29.456680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 166/333] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:29 2022] GET /identity/v3/users/8b10d87b0e8d4612a7da1a6c885eed51 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:29.462719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:29.579144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db011-fb6b-4a19-9547-58f5d647220d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:29.620025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:29.621088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:29.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:29.622081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] PATH_INFO: `/v3/system/users/8b10d87b0e8d4612a7da1a6c885eed51/roles/88b25505d32b467e90329efbee33ec33` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:29.623771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b10d87b0e8d4612a7da1a6c885eed51, role_id=88b25505d32b467e90329efbee33ec33)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:29.625151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9967adc-b3a2-4d7e-a80e-f8d7d18ce2cd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:29.637189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1334 bytes} [Sun Aug 7 18:07:29 2022] PUT /identity/v3/system/users/8b10d87b0e8d4612a7da1a6c885eed51/roles/88b25505d32b467e90329efbee33ec33 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:31.310803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221cb8d-e6fb-4402-9380-3b378397cdcc None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.311291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221cb8d-e6fb-4402-9380-3b378397cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.311291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221cb8d-e6fb-4402-9380-3b378397cdcc None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.312883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 167/335] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:31.318224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffe36-8b04-4a5b-aa53-d7b33534c13a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.318653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffe36-8b04-4a5b-aa53-d7b33534c13a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.318757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffe36-8b04-4a5b-aa53-d7b33534c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.340592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a4bffe36-8b04-4a5b-aa53-d7b33534c13a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:31.341770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a4bffe36-8b04-4a5b-aa53-d7b33534c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.362251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.423522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:31.463892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221cb8d-e6fb-4402-9380-3b378397cdcc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.502063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e78e-bcd0-4618-a6ea-9a3addf37485 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.502386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e78e-bcd0-4618-a6ea-9a3addf37485 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.502599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e78e-bcd0-4618-a6ea-9a3addf37485 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.504056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 170/337] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:31.510328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.510636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.510878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.542592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.547051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:31.548268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:31.643724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221cb8d-e6fb-4402-9380-3b378397cdcc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.672476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 171/338] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:31.701591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:31.702259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:31.702534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:31.702798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:31.712399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.737926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:31.749392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:31.750355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:31.751144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:31.755830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 168/339] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:31.757769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:31.910860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:31.949848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d723f8e-bef8-4fbc-bb89-d6e99f21d506 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.961067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402be6f-1aae-4588-a05e-dec189fc7132 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:31.992333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.026626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.027283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.027566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.027898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.034605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.035876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.036147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.036409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.037084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:32.037380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.038813 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.053371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 169/340] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:32.054934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:32.058836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:32.059893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:32.060746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:32.061568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:32.065945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 172/341] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:32.067748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.235556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d184286-ca57-498b-89fc-82555b7b7a9e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.280690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.281366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.281560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.281830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.303852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3bee8-c4bd-43e9-9a3f-7269f8d198ff None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.354604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.379877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.380523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.380758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.381023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.381691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:32.382024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.383393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a759-08ad-45d2-bc73-117b60f08c44 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.403790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 173/342] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:32.408876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.410989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6d3e-6c9e-43ce-a520-573f96e0ca73 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.413978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09009-685e-4028-9c0f-d7cf9edf65b8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.414260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09009-685e-4028-9c0f-d7cf9edf65b8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.414526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09009-685e-4028-9c0f-d7cf9edf65b8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.416025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 174/343] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:32.419110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e09009-685e-4028-9c0f-d7cf9edf65b8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.441588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.568635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e09009-685e-4028-9c0f-d7cf9edf65b8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:32.609227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:32.610283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.610762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.611244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.611525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 170/344] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:32.616874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:32.617161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:32.617432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:32.643069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:32.644704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:32.702053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:32.703918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:32.714292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.783579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 171/345] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:32.784517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.802101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:32.842617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 175/346] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:32.846748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:32.994591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f4b6d-805f-4b66-b4ef-a832e1242a11 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.002800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.008245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653701-d64e-4956-95e3-63004b3e1ff4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.033545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.034281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.034554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.034927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.045525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:33.048005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.048860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.049368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.049834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:33.050243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:33.051766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:33.052576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 176/347] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:33.053233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.054917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.056571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be3db-4765-4059-94aa-f02a539c6b7d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.058725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 172/348] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:32 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.060077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d350-c88b-4101-a23d-3da196467da0 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.060553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d350-c88b-4101-a23d-3da196467da0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.061012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d350-c88b-4101-a23d-3da196467da0 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.062444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 173/349] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:33.063543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d350-c88b-4101-a23d-3da196467da0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.153588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.172319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48865544-f665-459c-b189-9b38c7fb0f8b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.195323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d350-c88b-4101-a23d-3da196467da0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.217617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.218666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.220076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.220076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.221492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.223517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.225492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 177/350] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.226291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.249584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.250224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.250497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.250882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.251484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:33.251829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.253190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17ae8-874b-42c8-9964-0c2a538ef3c1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.263956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 174/351] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.265415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb09f1-0286-4fff-b001-05e3ed43605d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.265702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb09f1-0286-4fff-b001-05e3ed43605d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.266758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb09f1-0286-4fff-b001-05e3ed43605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.270018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.288851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a3bb09f1-0286-4fff-b001-05e3ed43605d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:33.290076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a3bb09f1-0286-4fff-b001-05e3ed43605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:33.356657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f051cd-c7ec-4974-82dc-198703972582 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.371383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 175/352] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:33.372742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363073-27d7-40f7-9eba-afe429eb5f29 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.373024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363073-27d7-40f7-9eba-afe429eb5f29 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.373292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363073-27d7-40f7-9eba-afe429eb5f29 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.375435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 176/353] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:33.376139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363073-27d7-40f7-9eba-afe429eb5f29 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.407683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.408295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.409041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.411746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.418215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.419939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.421578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 178/354] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.422378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.465664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.507876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363073-27d7-40f7-9eba-afe429eb5f29 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.537745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.543495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48024abb-14cc-4d2d-b27a-247e3a8aa631 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.552324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.553056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.553333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.553597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.554747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.556173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e3821-f4cd-4afc-b4c0-fc2399b09935 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.562653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 177/355] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.562653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.562653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.562653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.583800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:33.584975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:33.596927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.596927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.596927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.596927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.666220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 178/356] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:33.667040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.680183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.681617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.741604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.784188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702f8de-1200-495e-8d6d-0e1010a68abf None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.793081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:33.802510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 179/357] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:33.803502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.825869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.826562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.826837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.827126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.838202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:33.843008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:33.843878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:33.844667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 179/358] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:33.845344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:33.927551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9a7f-db28-4873-be52-72080d2aa7ae None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.963632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd86dfb-498e-426e-aba0-cf938dce32f5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:33.966415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:33.967063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.967340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.967608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.968358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=8679ca462ab94d648d02fc0dff98697d) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:33.968658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:33.970182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a87a-eaa3-4dd6-9c58-388befcaa20b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:33.979657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 180/359] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:33.980882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe151-0d67-4b77-bd26-4b921d7604f3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:33.981193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe151-0d67-4b77-bd26-4b921d7604f3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:33.981464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe151-0d67-4b77-bd26-4b921d7604f3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:33.982705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 181/360] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:33.983427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe151-0d67-4b77-bd26-4b921d7604f3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.016875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.041342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.042010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.042306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.042584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.043347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=8679ca462ab94d648d02fc0dff98697d) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.043655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.045138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.052788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 180/361] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.054007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.076037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.141312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe151-0d67-4b77-bd26-4b921d7604f3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.192164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.192893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.193274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.193666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.205507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:34.208944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391cadf-cd37-4a56-9383-c11b1ba06de9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:34.212351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:34.213504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:34.214543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:34.216111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 182/362] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:34.217115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.257927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.257927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.257927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.257927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.258374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.258374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1f575-46d3-49cf-b155-ba794b4c59d2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.259771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 181/363] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.261064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.261445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.261787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.281618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:34.283204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:34.346338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b571070-8f3e-4a5c-ab38-2e3d3a6d4890 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.350665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.373459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 182/364] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:34.375015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.379626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.392793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.393403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.393948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.394744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.395410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.395724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.397185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.408709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 183/365] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.409573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.535164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ade17d-49d3-491b-aae8-9f9ac8c76efd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.541297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a52ee-c84c-4150-810f-ed388f622309 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.587920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.588479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.588602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.588808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.589058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.589947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.590178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.590703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.591182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.591734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.592256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.592762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.593616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 184/366] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.594620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.596814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.606044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 183/367] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.607241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.660849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.667806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.715869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95e43-a3da-4e55-a74b-68a4dec943be None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.725522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e907a-e909-41fd-aa4a-45de37f5a90d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.752548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.753155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.753911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.754219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.764654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.764989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:34.765778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.766295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.766791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] PATH_INFO: `/v3/users/8b10d87b0e8d4612a7da1a6c885eed51` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.768252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] RBAC: Authorizing `identity:get_user(user_id=8b10d87b0e8d4612a7da1a6c885eed51)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.770301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:34.770521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:34.771391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 185/368] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:34.777233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.780632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 184/369] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/users/8b10d87b0e8d4612a7da1a6c885eed51 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.781817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:34.889466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c03891-f445-4e14-af02-9659c6659069 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.897015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28269b0-d49a-441b-94d4-7376a264e891 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:34.906149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.918145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:34.930790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.931397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.931669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.932030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.932643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=fe9c2c8e272f4858bafa17d114954723) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:34.932941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:34.935059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:34.938835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:34.939768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:34.940248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:34.940714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:34.941500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 186/370] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:34.950588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.019433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.021375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.101052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a480-e174-4592-b4f7-8bc3356c6b3f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.142808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 185/371] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:35.145264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.150519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.151145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.151425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.151693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.152364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.152664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.154051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.172160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 187/372] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.172160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.182852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.232840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.269555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599410-b162-4eb5-a1b1-c96c7371980d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.307934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.309005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.309552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.310099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.311093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] RBAC: Adding query filter params (role.id=88b25505d32b467e90329efbee33ec33, user.id=8b10d87b0e8d4612a7da1a6c885eed51, scope.system=all) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.311704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.313541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.327936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a15-3082-406b-b920-d97685a605b6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.329865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 186/373] 10.222.0.30 () {56 vars in 1308 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/role_assignments?user.id=8b10d87b0e8d4612a7da1a6c885eed51&scope.system=all&role.id=88b25505d32b467e90329efbee33ec33 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.331177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.411499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.412168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.412380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.412587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.414783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.416210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.421928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 188/374] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.427285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.473233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.520844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c80a3-8c61-4d5c-b99a-c8f2b303f891 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.586187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f3ed-52b0-4bed-a335-ff71a9b2150f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.596932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.625402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.626084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.626361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.626622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.629016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.629637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.629922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.630197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.633130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.634613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.637375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 189/375] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.642972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.761131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187b5a-d56e-4b12-8955-6065f5a7513e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:35.762275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.764056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.800324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:35.801378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:35.801801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:35.802098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:35.802816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=fe9c2c8e272f4858bafa17d114954723) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:35.803118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:35.804920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:35.812110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 190/376] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:35.888616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:35.925828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 187/377] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:35.931804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:35.993363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.065325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99a3f-4ea2-494f-96a3-350e348e522a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.103798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.104426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.104699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.104963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] PATH_INFO: `/v3/projects/ca66a08084ae46fb86e1033ed40d8182` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.106101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=ca66a08084ae46fb86e1033ed40d8182)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.107518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.109424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 191/378] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:35 2022] GET /identity/v3/projects/ca66a08084ae46fb86e1033ed40d8182 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.115963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.236634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc1c21-b638-4179-aabe-cea3c61c74ca None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.279887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.280520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.280793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.281063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] PATH_INFO: `/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.289449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=3ea5de1d3c0d4436ae7e75d44ed55988)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.290920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391c8f4-da82-43ff-be57-3f10a2d79bb4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.292885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 188/379] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.298880 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.410567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5978a-20f2-4663-9620-6c4ac842d70e None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.410956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5978a-20f2-4663-9620-6c4ac842d70e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.411085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5978a-20f2-4663-9620-6c4ac842d70e None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.412646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 189/380] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:36.417851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.418198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.418471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.462930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:36.464110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:36.472557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50bd1d-c1ec-4ff9-9753-ce87a4d4f1d4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.482921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.515648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.516601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.517071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.517531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.518807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] RBAC: Adding query filter params (group.id=3ea5de1d3c0d4436ae7e75d44ed55988, role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=ca66a08084ae46fb86e1033ed40d8182) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:36.520053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:36.521824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f88a-961e-4a8e-9789-05a9173ad81e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:36.529019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 192/381] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/role_assignments?group.id=3ea5de1d3c0d4436ae7e75d44ed55988&scope.project.id=ca66a08084ae46fb86e1033ed40d8182&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:36.530112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c507-532e-4f5b-a519-93dc59323a0e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.530392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c507-532e-4f5b-a519-93dc59323a0e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.530660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c507-532e-4f5b-a519-93dc59323a0e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.532172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 193/382] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:36.543467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.543771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.544002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.566700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.587060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:36.588463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:36.597767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 190/383] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:36.622424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.698697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 194/384] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:36.723445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.764540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca78c5-9bd6-4a19-9bd5-0257dbac3eb4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.809205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.810347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.810847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.811323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.823382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:36.828841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:36.829723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:36.830990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:36.833445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 191/385] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:36.840075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:36.843554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.847424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a899-5939-4720-a192-b17fe1d14926 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:36.880322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:36.901818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee748-f778-411c-badf-781839813913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:36.902823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee748-f778-411c-badf-781839813913 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:36.903107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee748-f778-411c-badf-781839813913 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:36.903379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ee748-f778-411c-badf-781839813913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:36.918776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ee748-f778-411c-badf-781839813913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ed8ee748-f778-411c-badf-781839813913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:36.925107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:36.926717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:36.927767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:36.928816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 195/386] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:36.934845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee748-f778-411c-badf-781839813913 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.000789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d476a5-149a-4508-b5f2-27ef744f1ab6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.073381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.074360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.074811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.075251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.076124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.076607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.078286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.099739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 192/387] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:37.105085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.137632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ee748-f778-411c-badf-781839813913 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.183838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.184764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.185216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.185753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.186602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:37.187076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.188648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.200660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 196/388] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.206455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.233982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.283290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.296117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d297-cb56-4c6b-b589-8475b94b92d5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.317583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4355c9-0c45-49ca-a41b-c30b77c74619 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.351981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.352905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.353358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.353822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.355138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.357565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.359702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 197/389] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.365694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.423196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.423844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.424109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.424370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.430591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.432041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.433940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 193/390] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:37.439453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.471439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a423cd-5b86-4f68-9a0b-7444a29808f8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.502335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.509686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.510605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.511057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.511500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.513085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.514714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.517193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 198/391] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.524103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.549345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc275f5-6c64-496a-8b89-4c0954e03e73 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.585244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.586064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.586167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.586405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.587523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.588953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.590882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 194/392] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:37 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:37.598897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:37.659359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:37.669822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f699f-f86f-4e53-a12c-71548cb76dd2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.736474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.737524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.739153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.739784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.742609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, group_id=80c8344c3b9540f48b4e54f75dbcae1d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.746998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86377bbb-c3f2-459a-aaff-5b47000d159f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.767379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 199/393] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:37 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:37.795385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bf41-6ca5-4eca-920d-f384df54c768 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:37.842962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:37.843650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:37.843926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:37.844198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:37.846509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] RBAC: Authorizing `identity:create_grant(project_id=8679ca462ab94d648d02fc0dff98697d, group_id=80c8344c3b9540f48b4e54f75dbcae1d, role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:37.848506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe6fe8-b04f-4238-83b3-36264cb1e7fb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:37.868466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 195/394] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:37 2022] PUT /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:38.124412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad4c2-a03c-4c56-844a-a3b03c98cf49 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.124748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad4c2-a03c-4c56-844a-a3b03c98cf49 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.124919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad4c2-a03c-4c56-844a-a3b03c98cf49 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.126511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 200/395] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:38.131637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.131923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.132195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.153222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:38.155490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:38.236532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 196/396] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:38.271205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ad4c2-a03c-4c56-844a-a3b03c98cf49 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.300488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.411231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ad4c2-a03c-4c56-844a-a3b03c98cf49 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.451204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.451836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.452160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.452433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.468844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-db9cf3c9-bff8-43e9-9fae-72c80a6e6cc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:38.475413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:38.476286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:38.477073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:38.477670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 201/397] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:38.484105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.516993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.611733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57865e6f-0319-4309-b484-19f2589c39aa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.651889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140957c-aa81-403f-892f-9593b4a4f9a7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.652421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140957c-aa81-403f-892f-9593b4a4f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.652421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140957c-aa81-403f-892f-9593b4a4f9a7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.653747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 202/398] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:38.659251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.659567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.659845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.665830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.666483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.666760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.667414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.669061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:38.669367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.674356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.678920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:38.680116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:38.686662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 197/399] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:38.692792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.794271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.810590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b666d-7523-4110-b280-d7c1f297dc89 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:38.816493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 203/400] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:38.869345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.869661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:38.870286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:38.870565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:38.870878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:38.872147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:38.873692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:38.875649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 198/401] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:38.880865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:38.886693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:38.991970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead335f-2b02-49dd-90d7-1dfd4cd049e5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.033512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.036242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.036525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.036797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.038611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.040267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.042297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 199/402] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:39.047910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.053864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865f32c-9508-40aa-8c6b-3a0c375c40ca None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.092814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.108068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.109017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.110163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.110654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.138388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c79d3ba9-7bc6-4512-b7f8-fa7218b3eb58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:39.147112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:39.147982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:39.148811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:39.151855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 204/403] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:39.157891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f04c05-d648-4973-b33a-0c9b5ac4bc50 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.158377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f04c05-d648-4973-b33a-0c9b5ac4bc50 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.158795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f04c05-d648-4973-b33a-0c9b5ac4bc50 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.160262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 205/404] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:39.161479 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f04c05-d648-4973-b33a-0c9b5ac4bc50 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.216382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5b91-20cb-4e35-a877-ae90d7617b2b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.237023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.258786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.259378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.259655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.259924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.263004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, group_id=80c8344c3b9540f48b4e54f75dbcae1d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.264477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc49b4-14bb-4af2-8fd5-57ebf2fabd17 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.282954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 200/405] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:39 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:39.284482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.284823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.285361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.292017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f04c05-d648-4973-b33a-0c9b5ac4bc50 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.306953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:39.308186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:39.341395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.342140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.342418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.342684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.343356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.343670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.345105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.364974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 206/406] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:39.371217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.384900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 201/407] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:39.407184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.415975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.523939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c2e84-80db-4a82-855d-aa477ef53203 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.537268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316db70-53e8-425a-9d7b-82a280568ffe None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.567850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.577367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.578343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.578622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.578889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.580449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.582395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.583750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.588669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 207/408] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:39.588806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.588806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.588806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.590432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.602501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:39.608865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:39.609804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:39.610864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 202/409] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:39.617926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.714358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb1f42-c2d0-48db-909c-fbaf66c52417 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.752632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.753930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.754287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.754943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.756154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.757609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.759353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 208/410] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:39.765125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:39.781967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.838029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:39.864166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab67d6-b124-4c2e-acb4-b3437dddcd66 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.878956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220d5b-507f-4721-aad2-60553fc00125 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:39.924950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.926465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.927711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.930835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.933211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9c2c8e272f4858bafa17d114954723, group_id=80c8344c3b9540f48b4e54f75dbcae1d, role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.934836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.957819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 209/411] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:39 2022] PUT /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723/groups/80c8344c3b9540f48b4e54f75dbcae1d/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:39.968366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:39.969247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:39.969674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:39.970156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:39.970992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:39.971606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:39.973721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:39.986369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 203/412] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:39.992033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.115594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9456-cd56-41bf-8155-18cebeb59150 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.144411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.153822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.154536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.154813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.155082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] PATH_INFO: `/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.156940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] RBAC: Authorizing `identity:get_group(group_id=3ea5de1d3c0d4436ae7e75d44ed55988)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.158839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.161320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 210/413] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:39 2022] GET /identity/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:40.166188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.285317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97bbc-0df3-4df7-8ec4-12916972ed55 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.322432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.326012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.326687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.326963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.327230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] PATH_INFO: `/v3/projects/ca66a08084ae46fb86e1033ed40d8182` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.328375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] RBAC: Authorizing `identity:get_project(project_id=ca66a08084ae46fb86e1033ed40d8182)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.329815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74783517-a393-4682-b256-7ccd22fc6dbc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.332097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 204/414] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/projects/ca66a08084ae46fb86e1033ed40d8182 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:40.338954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.415406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ac42-04c1-42e2-a123-383887863858 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.415591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ac42-04c1-42e2-a123-383887863858 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.415856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ac42-04c1-42e2-a123-383887863858 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.417441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 205/415] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:40.422275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a18a-32be-4aa3-878a-b5ccec212301 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.422553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a18a-32be-4aa3-878a-b5ccec212301 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.422820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a18a-32be-4aa3-878a-b5ccec212301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.450191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-45c6a18a-32be-4aa3-878a-b5ccec212301 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:40.451367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-45c6a18a-32be-4aa3-878a-b5ccec212301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:40.502671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7c09-04bb-46b8-8499-4e92b2181f9e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.541117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.541776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.542081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.542355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] PATH_INFO: `/v3/projects/ca66a08084ae46fb86e1033ed40d8182/groups/3ea5de1d3c0d4436ae7e75d44ed55988/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.544247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] RBAC: Authorizing `identity:create_grant(project_id=ca66a08084ae46fb86e1033ed40d8182, group_id=3ea5de1d3c0d4436ae7e75d44ed55988, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:40.545729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:40.556380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 206/416] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:40.558476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb8c-20b8-4799-aae1-bdeba85336c6 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.558985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb8c-20b8-4799-aae1-bdeba85336c6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.559458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb8c-20b8-4799-aae1-bdeba85336c6 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.561131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 207/417] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:40.566602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.567123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.567591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.570238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 211/418] 10.222.0.30 () {58 vars in 1442 bytes} [Sun Aug 7 18:07:40 2022] PUT /identity/v3/projects/ca66a08084ae46fb86e1033ed40d8182/groups/3ea5de1d3c0d4436ae7e75d44ed55988/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:07:40.587694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:40.589223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:40.613782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.699144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.720303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 208/419] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:40.766684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320a15-d279-4f66-a414-360a2c53d1cf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.778995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.807054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.807998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.808462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.808907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:40.824609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:40.830610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:40.831567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:40.832379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 212/420] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:40.837818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:40.855756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.944047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd270a-68e3-4562-bfb2-0bd48e72ecfb None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.958741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546a3f0-bde9-40e7-99d1-f1bb688c15ec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:40.974387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:40.997625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:40.998621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:40.999069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:40.999489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.000281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.000721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.002445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.012691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 213/421] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:41.018818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.020355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.021104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.021481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.021848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.045053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:41.050176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:41.051277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:41.052145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:41.053110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 209/422] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:41.059552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.136021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb43b6-bad8-4450-bb4f-87693a874429 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.173261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.174209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.174680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.175252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.239015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.251647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b814e-b018-4287-a378-a80cb332d3c5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.278507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.279953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.287795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.318262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.318868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.319142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.319408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.320072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.320368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.321765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.334694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 210/423] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.363503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.420095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 214/424] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:41.426553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.504780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03edca0-ce2c-437f-af11-11d7bffd1b1c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.509440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.538662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983bfe1-5506-4a42-b9c6-b58c6692b0cd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.564984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.566283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.566568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.566823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.577969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.578880 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.579351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.579821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.581190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.583054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.585182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 215/425] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:41.590802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.669971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.702564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4128c-e8ca-4282-b0c5-9931738c45ec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.713628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.715173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c0d0-9545-488c-9922-7e9a77403179 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.740024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.741007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.741516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.742099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.743432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.745122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.746905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 216/426] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.752790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.770073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:41.864266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096ca95-8dc5-4750-ac0c-49206411a36d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:41.912293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:41.912901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.913176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.913441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.917510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=8679ca462ab94d648d02fc0dff98697d) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:41.917510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:41.917510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:41.922781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 211/427] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:41.924049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9fd46-1c6f-4e38-8041-31a647ef5514 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.924332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9fd46-1c6f-4e38-8041-31a647ef5514 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.924597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9fd46-1c6f-4e38-8041-31a647ef5514 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.926640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 212/428] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:41.927927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 217/429] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:41.933570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:41.933881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:41.934303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:41.934644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:41.975183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:41.977151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:42.029920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.061432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788af80-6e6b-484a-ac24-cd47b269dc05 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.102117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.103028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.103495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.103923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] PATH_INFO: `/v3/projects/8679ca462ab94d648d02fc0dff98697d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.105797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] RBAC: Authorizing `identity:get_project(project_id=8679ca462ab94d648d02fc0dff98697d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.107768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.110006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 218/430] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:41 2022] GET /identity/v3/projects/8679ca462ab94d648d02fc0dff98697d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:42.116593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.179210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 213/431] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:42.213834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.231578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.233913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7ea2-6e93-47ec-9be7-4949452dceea None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.271029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.271707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.271985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.272334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.273401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.274856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.276409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 219/432] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:42.282250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.298001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.341925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f8e5-5c8e-4a2c-bc5a-523eb448926b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.394883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.395530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.396150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.396424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.407045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ff2a-3688-4bba-b5d4-44b97adc602a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.417934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-534c22ea-7a1a-47df-ab41-efa87099d1c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:42.418864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.419735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:42.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 214/433] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:42.421627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667750-99ec-4baa-883e-efdc24be19fa None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.421627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667750-99ec-4baa-883e-efdc24be19fa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.421880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b667750-99ec-4baa-883e-efdc24be19fa None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.423472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 215/434] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:42.436992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667750-99ec-4baa-883e-efdc24be19fa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.459723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.460759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.461277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.461785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.462885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=8679ca462ab94d648d02fc0dff98697d) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.463382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.465030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c78f7a-71e1-4561-b650-0429ccc3d338 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.474177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 220/435] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=8679ca462ab94d648d02fc0dff98697d&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:42.477578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.478261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.478757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.504036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:42.505667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:42.550014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.600783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b667750-99ec-4baa-883e-efdc24be19fa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.632233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 221/436] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:42.648549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.649172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.649449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.649714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.650412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:42.650709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:42.652145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:42.662806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 216/437] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:42.668625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.679934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.686832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:42.848590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355b63-cc8b-4381-b991-cbcf71bbebf9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.857251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909ec85-f439-48fe-847a-ce825b440f71 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:42.906509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:42.916622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.917328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.917580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.917889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.920805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:42.921435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:42.921710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:42.922927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:42.944879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:42.951754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:42.952646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:42.953479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 217/438] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:42.960459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.010798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.013660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.024182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.096366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb124-495c-4224-b871-7bc2c5ad86c0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.137108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 222/439] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:43.137278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.137278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.137278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.137543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.138462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.138567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.138847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.140579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.152756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 218/440] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:43.158325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.210085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.240358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c02b-cda1-4bcc-b4aa-6e28a8cb695b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.247627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.257406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e7be2-62e1-4d59-85e3-2c7a0eb80901 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.274316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.274935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.275207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.275472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.276576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.278028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d816aac-90ab-4540-af39-2a4c4eb46728 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.279624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 223/441] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.280718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3c4e-563d-428f-b46a-68f934a56b9a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.280995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3c4e-563d-428f-b46a-68f934a56b9a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.281331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a3c4e-563d-428f-b46a-68f934a56b9a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.282527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 224/442] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:43.285579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3c4e-563d-428f-b46a-68f934a56b9a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.293762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.294400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.294673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.294937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.359587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.361027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.384743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a3c4e-563d-428f-b46a-68f934a56b9a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.410448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.418903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.419510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.419781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.420051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.421119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.422552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c54e25-c699-4b6b-8465-8f09c459cac3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.424075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 225/443] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.425176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.425578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.425844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.442669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:43.443853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:43.464659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 219/444] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:43.465495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.491226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.523379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 226/445] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:43.524243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.567903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f66d7e-3352-48d0-ac7d-42486d02c50e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.602291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.602885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.603161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.603422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.604137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=02e0e6ea5d5742a9ba9df0b9cef154f8, scope.project.id=fe9c2c8e272f4858bafa17d114954723) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.604444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.605863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.611456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 220/446] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.612220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.621452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a806b-33f4-4c0a-aec1-526f590014eb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.645426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.660148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.661252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.661517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.661850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] PATH_INFO: `/v3/projects/fe9c2c8e272f4858bafa17d114954723` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.663154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] RBAC: Authorizing `identity:get_project(project_id=fe9c2c8e272f4858bafa17d114954723)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.664658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.671022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 227/447] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/projects/fe9c2c8e272f4858bafa17d114954723 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:43.672540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.720921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.744647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b12a50-b056-43d9-900f-0b6fe363620d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.786539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.787264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.787535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.787820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.789761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305078a-7740-436a-9ce5-4f1c6a519cbc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.799980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:43.805561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:43.806535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:43.807332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 221/448] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:43.812771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.832353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.832994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.833262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.833528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] PATH_INFO: `/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.834798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] RBAC: Authorizing `identity:get_group(group_id=80c8344c3b9540f48b4e54f75dbcae1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.836538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.838747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 228/449] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/groups/80c8344c3b9540f48b4e54f75dbcae1d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:43.845095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:43.909858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.938102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc638-5895-40a0-8760-0ed1869e2bfe None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.964425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356dbc-0213-4f4f-a736-e43740c55538 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:43.975909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:43.981701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:43.982412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:43.982690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:43.982985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:43.983646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:43.983944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:43.985307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:43.993815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 222/450] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:43.999430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.001456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.002088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.002362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.002626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.003858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] RBAC: Adding query filter params (group.id=80c8344c3b9540f48b4e54f75dbcae1d, role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=fe9c2c8e272f4858bafa17d114954723) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.004156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.005590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.011282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 229/451] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/role_assignments?group.id=80c8344c3b9540f48b4e54f75dbcae1d&scope.project.id=fe9c2c8e272f4858bafa17d114954723&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.104292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5082-8730-40d9-b0fe-2287ad55e8b4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.139574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.140187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.140465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.140735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.150281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.212069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.213432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.311733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 223/452] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:07:44.317478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.415579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc8761-24f2-40a0-a41d-9d86439cb283 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.448970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.449585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.449862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.450160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] PATH_INFO: `/v3/projects/ca66a08084ae46fb86e1033ed40d8182` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.451262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] RBAC: Authorizing `identity:get_project(project_id=ca66a08084ae46fb86e1033ed40d8182)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.452675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.454317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 230/453] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/projects/ca66a08084ae46fb86e1033ed40d8182 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.459919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.497690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.561697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dca67e-9839-4f3f-895f-c257746da36f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.595940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.596549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.596849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.597116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] PATH_INFO: `/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.598223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] RBAC: Authorizing `identity:get_group(group_id=3ea5de1d3c0d4436ae7e75d44ed55988)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.599664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77aedc-be04-4f82-be98-eb04e6d653fa None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.601192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 224/454] 10.222.0.30 () {56 vars in 1180 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/groups/3ea5de1d3c0d4436ae7e75d44ed55988 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:44.607093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:44.648053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:44.703685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1058-8acc-499e-a0e7-4eda958949ce None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:44.742334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:44.742947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:44.743203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:44.743470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:44.744184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] RBAC: Adding query filter params (group.id=3ea5de1d3c0d4436ae7e75d44ed55988, role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=ca66a08084ae46fb86e1033ed40d8182) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:44.744486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:44.745890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc5d3c-29a8-47c3-85cb-d6e5001ad827 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:44.751519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 231/455] 10.222.0.30 () {56 vars in 1376 bytes} [Sun Aug 7 18:07:44 2022] GET /identity/v3/role_assignments?group.id=3ea5de1d3c0d4436ae7e75d44ed55988&scope.project.id=ca66a08084ae46fb86e1033ed40d8182&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:47.358770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37474-e6ee-4f7f-a096-bc838053c571 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.359533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37474-e6ee-4f7f-a096-bc838053c571 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.359533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb37474-e6ee-4f7f-a096-bc838053c571 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.360888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 225/456] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:47.366451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.366958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.367119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.390304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:47.391642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:47.456093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73fe48-88d9-4f2e-a395-e9fafd8efe63 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.456412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73fe48-88d9-4f2e-a395-e9fafd8efe63 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.456632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73fe48-88d9-4f2e-a395-e9fafd8efe63 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.457990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 226/457] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:47.463073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.463347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.463617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.492666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 232/458] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:47.493464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:47.494710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:47.535834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.570971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.601392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 227/459] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:47.623281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.654780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39bb6-1009-463f-b079-58a533a3cb5e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.694341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.694971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.695246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.695513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.721429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.723687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.724846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:47.745620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.746700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:47.747618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:47.747618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.747618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:47.747618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 233/460] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:47.753911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.801185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022261ba-ca2e-4ca5-a3a9-3f9cf4151634 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.849620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.850357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.850630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.850897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.863205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.865094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-477fba68-3546-4393-ba61-71893238d1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:47.894531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:47.895604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:47.896508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:47.896508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:47.896508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:47.897481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 228/461] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:47.899085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4f42-380d-4427-9fc9-2fb95ea1a9f3 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.899424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4f42-380d-4427-9fc9-2fb95ea1a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.899761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4f42-380d-4427-9fc9-2fb95ea1a9f3 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.901417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 229/462] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:47.902652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507468-22bd-4722-8456-e5105f38057d None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.903041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507468-22bd-4722-8456-e5105f38057d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.903375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507468-22bd-4722-8456-e5105f38057d None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.904872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 230/463] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:47.905738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507468-22bd-4722-8456-e5105f38057d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:47.919659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:47.937311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eb15e-ab4c-4ef3-94de-e9a21290da4b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:47.973626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:47.974324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.974638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.975016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.975654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:47.975949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:47.977353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321f91-d92d-4043-ac6d-8fe7c9171b37 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:47.990882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 234/464] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:47.995257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:47.995765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:47.996043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:47.996364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.012239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507468-22bd-4722-8456-e5105f38057d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.013539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:48.015321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:48.048520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.049124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.049377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.050170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.050823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.051115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.052483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e475-874d-4b84-8e50-b450b9965c66 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.069891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 231/465] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.071139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.071415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.071678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.090315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 235/466] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:48.090594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:48.091645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.091774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:48.162027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 232/467] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:48.162027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.188940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.215884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898471-7fe7-46d9-84c4-6fb3bc277fa0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.255464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.255938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.256564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.256845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.257143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.257821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.259330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.281684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cb1e8-6b4e-4353-89fc-5bf3e4c422b4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.282492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 236/468] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:48.283134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.339831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.340842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.341407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.342800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.343845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.347132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.377981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 233/469] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/users => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:48.378928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.453437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4881ea-6cc7-4537-83d1-912b0bdfda11 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.505789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.514342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.514673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.514976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.515207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.530262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.532223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.544088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b59d-a503-4b82-9f26-57da39fe705d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c3377643-9fce-4260-849f-1d7c3f3e147d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:48.549334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:48.550889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:48.551737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:48.551737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.551737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:48.554328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 237/470] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:48.555352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37e2b-2517-4f6f-b121-e3c8b682570d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.555890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37e2b-2517-4f6f-b121-e3c8b682570d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.556074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37e2b-2517-4f6f-b121-e3c8b682570d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.557411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 238/471] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:48.558189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c37e2b-2517-4f6f-b121-e3c8b682570d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.590033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.590965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.591280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.592275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.593621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.607222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.608737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-dc814c46-5261-4c25-9791-b84eef356690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:48.627434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:48.628495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:48.629359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:48.629359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:48.629359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:48.629359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 234/472] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:48.630382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.630577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.630814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.652895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:48.655570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:48.688271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c37e2b-2517-4f6f-b121-e3c8b682570d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.727262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.727784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.728056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.728317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.728949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.729247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.730649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.739957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 235/473] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:48.741232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.748480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 239/474] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.754363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.821675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.851288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef730-0441-4e44-8ca5-ccb3b2e0ad02 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.871425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:48.895404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.896089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.896427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.896759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.897225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce591-f2f9-4ed4-a5bb-54a8637d3ca1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:48.897543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:48.897934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.899636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.916077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 236/475] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:48.917162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:48.934085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:48.934965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:48.935346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:48.935709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:48.936460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:48.938021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:48.963465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 240/476] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:48.964379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.096349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2e0e-c73d-437a-a4aa-1ff3d9aec88f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.134103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.134809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.135203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.135536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.136666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.140017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.148890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.sql.core [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:49.148890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 18:07:49.148890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [parameters: {'id': '76f6e8b69dbd4b1086d0f9ce79afdde1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 18:07:49.148890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80186) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:07:49.165974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:07:49.166950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application yield resource Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise self.value Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application session.commit() Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:07:49.167894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:07:49.168802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:07:49.169709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:07:49.170579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [parameters: {'id': '76f6e8b69dbd4b1086d0f9ce79afdde1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.171363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 18:07:49.172167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.173078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 237/477] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:49.174581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.189523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.192803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af7bb4-fa70-4e24-a70c-7d5e085d3d58 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.227542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:49.234507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.235655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.236787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.237310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.238181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.240092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.266179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 241/478] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:48 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:49.289997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f02f-ed76-4295-a4d2-d3952d20bfe9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.328846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.329531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.329805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.330110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.342895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0862a0a1-8c91-4f5d-90a3-5cf82a908d29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:49.348328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:49.349257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:49.350101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 238/479] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:49.356720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:49.470938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c662-e341-46fb-b044-5ce2fc4070f4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:49.511946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:49.512928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:49.513412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:49.513873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:49.514777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:49.515283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:49.516847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba91a65-067b-41a8-b7d8-6a3be6f36832 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:49.530648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 242/480] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:50.716697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de54f-8642-46fa-b61d-6e31d02bb56c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.717215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de54f-8642-46fa-b61d-6e31d02bb56c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.717215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de54f-8642-46fa-b61d-6e31d02bb56c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.718800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 239/481] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:50.730738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.731218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.731293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.762993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:50.764261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:50.778823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:50.831279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cf509-f7e8-4e15-bd98-33bae2223a80 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.831621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cf509-f7e8-4e15-bd98-33bae2223a80 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.831802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cf509-f7e8-4e15-bd98-33bae2223a80 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.833328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 240/482] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:50.838335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:50.838611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:50.838877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:50.855423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 243/483] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:50.872885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:50.874090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:50.878271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:50.981626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f81ba-a6e7-441c-b8a8-1ea9b83f1914 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.016920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.017545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.017822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.018132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.029308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:51.034113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.035001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:51.036193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 244/484] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.039270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 241/485] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:51.041481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.058274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.081861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.118925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.173658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df9dc-d6b1-4de1-a6df-5acb10f8ab42 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.210961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.211564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.211838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.212104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.212761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.213077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.215652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.223878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 245/486] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:51.229253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.244578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69102-fb80-4f48-954a-a4b53e0cd547 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.304211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.323138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.324175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.324647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.325102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.336024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4afe6-d1f1-4187-9234-56d85d8fa7be None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.362867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:51.367936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.368825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:51.369626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:51.372254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 242/487] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:51.374803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.375681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.376150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.377562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.379440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.400567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.403034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:51.428137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.429103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:51.429963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:51.429963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.429963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:51.434807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 246/488] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:51.437815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.545559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.558955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb7a-cffb-4a06-9f0c-45ba2e3956ae None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.601512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e480af8-04d6-4631-9067-39ed9af5c4a8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.603194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.603799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.604076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.604340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.605671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.605671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.606668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7325b44-fd0c-46b5-b66f-d5ad45ee89d6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.615726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 243/489] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.616917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848089c-11be-43a6-a7ea-fadd1de6609b None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.617204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848089c-11be-43a6-a7ea-fadd1de6609b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.617474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848089c-11be-43a6-a7ea-fadd1de6609b None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.622765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 244/490] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:51.622765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848089c-11be-43a6-a7ea-fadd1de6609b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.633447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.650159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.651077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.651659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.652116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.653018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.653552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.655099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84452c-0677-469c-acc6-a91aaa414f63 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.669258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 247/491] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.670906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.671323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.671729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.690757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:51.692285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:51.726049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848089c-11be-43a6-a7ea-fadd1de6609b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.762131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.762811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.763217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.763466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.774164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 248/492] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:51.774644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.775957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.776208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:51.791639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.792801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:51.793846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:51.793846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:51.793846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:51.795266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 245/493] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.800880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.805025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.906594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a608dc-364e-407a-addc-b9166aca4cfc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.921735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:51.924009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c527e1-60f0-42f6-94de-bd2bc92742b7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:51.947331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.947996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.948278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.948713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.957051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.958520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.960289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:51.961344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.961640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.961949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.962597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:51.962893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:51.964233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-480d4455-ddfc-466d-8373-bd5cb5384090 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:51.973492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:51.974639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 249/494] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d8646-08a5-48c9-b427-c9511c4bdd9a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:51.975976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d8646-08a5-48c9-b427-c9511c4bdd9a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:51.976944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d8646-08a5-48c9-b427-c9511c4bdd9a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:51.983597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 250/495] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:51.983597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d8646-08a5-48c9-b427-c9511c4bdd9a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:51.991047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 246/496] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:51.991047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.058463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.099687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e931e5-518a-4ec0-b68f-da5e2286595e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.103867 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d8646-08a5-48c9-b427-c9511c4bdd9a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.137394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.138121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.138465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.138800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.139582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.139981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.141257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.141443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.142107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.142480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.142842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.153999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-174455cd-88a0-44ff-be92-53c74e12b56c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:52.158746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.160029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:52.161073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:52.161935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 251/497] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.163065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.163348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.163614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.181296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:52.182507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:52.191369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 247/498] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.191369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.211020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.270464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 252/499] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:52.271401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.305164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403b90-3ee4-481d-977a-1bb50c09185a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.326879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.339091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.339778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.340058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.340324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.348208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.349793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:52.361876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.362973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:52.363876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 248/500] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.364425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.376060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa42b-680f-40b3-9e01-0def77395e77 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.409323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.409936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.410218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.410487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.411137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.411438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.412785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917123-29f6-43a6-aab4-7a68a7560995 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.420381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 253/501] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.421503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec11ffa-d8ad-4f68-900b-81f5d3f0f7f5 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.421781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec11ffa-d8ad-4f68-900b-81f5d3f0f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.422081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec11ffa-d8ad-4f68-900b-81f5d3f0f7f5 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.423255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 254/502] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:52.423939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec11ffa-d8ad-4f68-900b-81f5d3f0f7f5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.448897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.467880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b7e0-b569-4ef6-9b56-5bee3959e240 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.500190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.500782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.501052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.501313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.524450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec11ffa-d8ad-4f68-900b-81f5d3f0f7f5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.550366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.560398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.561023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.561299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.561573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.570428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.571895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.573797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:52.579500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.580386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:52.581685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 255/503] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.582930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.666695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.678861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 249/504] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:52.679694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.684834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26116a3-d25a-4887-9725-09c17823af53 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.718619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.719211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.719480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.719746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.720457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.720751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.722729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2468c-4b9d-444b-8eb3-1b97af208c4a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.757201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.758201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 256/505] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.759741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.760062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.760332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.777382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:52.778579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:52.779721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86984c1-9345-49cf-8c16-33292418a0ab None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.813982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.814607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.814880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.815177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.824808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.826270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:52.840347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:52.841335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:52.842236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:52.842236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:52.842236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:52.842236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 250/506] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:52.842236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.854088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 257/507] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:52.854088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.919216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.945844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31479-68dc-45c9-99a0-fdbc52a89cd2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.948271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4b26-f046-48a9-b2cc-1c555eeb8363 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:52.978788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.979394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.979671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.979947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.980598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:52.980898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.981408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:52.982055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:52.982318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:52.982485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:52.982612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:52.983654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:52.991140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 251/508] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:52.991935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:52.992816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:52.994377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:53.009399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.010491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:53.011341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:53.011341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.011341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:53.011341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 258/509] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.011341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.100241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944be88-06f2-4bdd-b340-dfcf00c8895e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.107288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1f27-1743-485b-bfe7-42f1e23b3e85 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.132359 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.133609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.134036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.134370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.134701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.144092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.144683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.144954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.145214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.145843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.146169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.147526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.158709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 259/510] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.159488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.197395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.204408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.205922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.255493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881546-1f6e-408b-bd35-cc566ac9098b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.288436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.289048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.289324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.289590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.300305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.301114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 252/511] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:53.301725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.301955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:53.316129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.317222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:53.318259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:53.318259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.318259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:53.318259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 260/512] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.322556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.357534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.392136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.399109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c341d-d503-47af-b2af-c0480dc88d14 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.421527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa13bfa-ce48-4e98-9e8c-5386f344c4aa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.432263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.432880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.433151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.433416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.443552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.444974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.454808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.455392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.455662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.456480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.457107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.457400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.458751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:53.459774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.460809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:53.461712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:53.461712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.461712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:53.461712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 253/513] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.462098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.472213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 261/514] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.473228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.559501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4dfba-c145-47ee-a6aa-f81a487888a7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.566642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.572583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f13b-8d7b-4a8f-aef7-bd3cd43704b4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.594263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.594884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.595158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.595425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.603235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.604698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.604979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.605598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.605870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.606163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:53.615719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.616712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:07:53.617613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:53.618543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.618613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 254/515] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.618677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.618741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.629085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:53.634582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.635644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:53.636994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:53.636994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:53.636994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:53.636994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 262/516] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.636994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.721138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb0ba0-588b-48b5-a4c0-81390c6efd8a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.735847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a169011-251b-4fce-a0ba-bb0f3e0d90b3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.754542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.755147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.755424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.755692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.756326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.756634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.758040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.769576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 255/517] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.769763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.770326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.770421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.770603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.770940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.771577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.771874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.773225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.785566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 263/518] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.787001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.797432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.837849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:53.871704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a764-e5d7-4257-90ad-e52059d06688 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.884756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ec224-d572-446e-ab1a-e4bfa43dc19b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:53.906002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.906621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.906892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.907156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.913517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.915004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.918272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:53.918872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:53.919151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:53.919423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:53.920136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:53.920448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:53.921835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:53.926899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:53.927891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 256/519] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:53.929087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:53.943825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 264/520] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:53.944624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.006836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.030319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6aa9-7e3d-47e8-8604-211f017489a9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.041345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94756c7e-b038-4363-a853-de246f2eecb5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.055636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.063665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.064269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.064550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.064824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.065551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.065856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.067261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.074951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.075546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.075822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.076088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.076707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.078132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.079016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 257/521] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.079598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.099978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 265/522] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:07:53 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:07:54.100891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.209772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cad769-3789-43e8-8746-2dd8c6cce0ce None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.215905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451fdf4-cd77-4c4a-b003-08049e1b0901 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.241144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.254150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.255094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.255285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.255645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.256083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.256694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.256975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.257248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.258148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.258973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.260539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.263159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.264574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:54.276676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:54.277577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 258/523] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:54.278649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.282906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 266/524] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.284474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.338607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.394376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975c26c-4ade-455e-9b26-0d1dc1992fb6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.397591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea01ba-9b0f-4858-b746-69f3830c7d4e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.433100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.433722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.434062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.434332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.437246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.438067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.438502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.438911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.441193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.442676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:54.455577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:54.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 267/525] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:54.457637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.504110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.521191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.522702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.570355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8be6b5-0faa-47b3-939a-bbd01b7d3d42 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.575085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.609228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.610031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.610408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.610787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.611514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.611820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.613850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.632124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 268/526] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.632951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.641773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 259/527] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:54.642782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.734628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.739178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957055b5-a544-4eaa-a4ae-029c8ae56930 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.753592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5da10b-b4cc-4c7f-ad8b-2deeb99f92d4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.776100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.776629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.776901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.777166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.777876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=06607bda2bed4773af2dce7a16b5c141) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.778207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.779626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.785471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 269/528] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/role_assignments?user.id=06607bda2bed4773af2dce7a16b5c141&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.786490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.800383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.801754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.802190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.802599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.803461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:54.803934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:54.805996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:54.828075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 260/529] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:54.829574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:54.849516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:54.938613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1bc90-7746-4c18-8f78-9055feeec3ce None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.955642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36c732-5730-420a-8f7c-7374ae6192fa None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:54.978431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.979029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.979305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.979912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:54.994443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:54.995462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:54.995945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:54.996412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.009029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.011974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.012182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:55.034740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:55.035666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:55.036500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:55.036500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.036500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:55.039446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 261/530] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:55.041172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.053490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.055013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.133004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.162052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 270/531] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:55.162893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.192101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a0895-72e7-484a-a253-143148460099 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.230243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.240488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.242298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.242821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.243298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.244256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.244816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.246607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.256282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 262/532] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.257930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.291636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf39ee4-cf85-42f6-9a7a-e63b8ca17b5a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.363432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.364062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.364342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.364613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.365268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.365564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.367018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.404557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 271/533] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.411044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.466263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc8d4-30aa-4e3d-8376-d6a132de30ca None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.510273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.524947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.525564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.525843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.526140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.545712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.547252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.563195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c733-5531-4d8d-a1db-1866506d9a4c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:55.575604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:55.576553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:55.577387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:55.577387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:55.577387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:55.577387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 263/534] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:55.583061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.611712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.613329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.614124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.615333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.629515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.633571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:55.652173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:55.653080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:55.653994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:55.658534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 272/535] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:55.669392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.747041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf3da-5b07-4785-973f-729bb8f5711b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.810997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.812252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.812690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.813119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.813921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.814378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.816412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.844412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 264/536] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.847576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:55.865618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f794d-9253-4221-80fb-274afcbb295a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:55.915487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:55.933074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:55.933966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:55.934404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:55.934819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:55.935645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:55.936891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:55.938536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:55.964381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 273/537] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:55.967232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.011869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770020c9-3e01-4609-bb91-1a59e6538e25 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.048815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.049846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.050344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.050966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.058410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.060369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:56.074264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:56.075156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:56.076094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:56.084189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 265/538] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:56.085766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.111759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.212385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.223485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000544bd-0dc9-47e4-86e5-4460790a3a62 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.241933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162de6b-8397-4f90-baad-b851b2b5c71b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.283618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.284837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.285107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.285368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.286074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.286369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.287792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a407bf3-9534-4600-875b-1b59f90ba988 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.304129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.304985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.305277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.305542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.306330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=21b6715254e34797a3af9b291d26b1dd) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.306639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.307315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 266/539] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:56.308077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487d412-d8e7-4dad-bbc5-6e4c89b2d633 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.308531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9036a-c2ca-4ff3-8205-56dcfcb968aa None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.308870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9036a-c2ca-4ff3-8205-56dcfcb968aa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.309137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9036a-c2ca-4ff3-8205-56dcfcb968aa None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.310635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 267/540] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:56.314882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9036a-c2ca-4ff3-8205-56dcfcb968aa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.318509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 274/541] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:55 2022] GET /identity/v3/role_assignments?user.id=21b6715254e34797a3af9b291d26b1dd&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:56.320089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.320576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.321046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.341231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:56.342951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:56.447964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 275/542] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:56.487770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.520707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9036a-c2ca-4ff3-8205-56dcfcb968aa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.561664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.580299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.581453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.581959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.582506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.584077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=45b5ef7c1c6a4698bd122c8d7327c723) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.584841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.587222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.608133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 268/543] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/role_assignments?user.id=45b5ef7c1c6a4698bd122c8d7327c723&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:56.659819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8adc77-a934-4743-b9fa-351e18ff786a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.698562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.699523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.700019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.700504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.713411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:56.718536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:56.719422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:56.720215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:56.723158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 276/544] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:56.728660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:56.753595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:56.858881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e81a-dfc6-4ccf-aaa9-1395c5f6a910 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:56.910155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:56.910888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:56.911170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:56.911502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:56.912174 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:56.912471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:56.913840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:56.922766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 269/545] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:07:56.931522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.056262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.060296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be72099-be2a-46cb-92ec-724775dd4825 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.100700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.101314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.101585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.101850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.112806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.114264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e1702ed0-89f7-4bca-9a91-9cb1c762708b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:57.129005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.130000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:57.130835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:57.130835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:57.130835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:57.130835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 277/546] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:57.136038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.215918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50826e-d3a9-4785-acf9-72dd4cd2b1d3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.216527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50826e-d3a9-4785-acf9-72dd4cd2b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.217005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50826e-d3a9-4785-acf9-72dd4cd2b1d3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.218820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 278/547] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:07:57.226281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.226822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.227261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.259953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:57.261166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:57.269319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.298439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c319-5299-4462-a0ad-7c4dad2bd723 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.366806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.367335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.367607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.367878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.368525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.369277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.370762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.386544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 270/548] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.392184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.397748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 279/549] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:07:57.427816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.541107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.563433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db6e4f-294a-4380-b413-f9ddf559dbe1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.569985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c49f-aa9b-42d7-bb8d-46c5628259e5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.601880 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.602772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.603256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.603769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.613683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.614451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.614839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.615338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.616144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-03486be6-d5f5-4665-bb9c-c8903e789024 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:57.621565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.623175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:57.624360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:57.625138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.626241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.626630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 280/550] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:07:57.629056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a31af-309e-47a4-99df-f7ee33e57f6f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.633108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a31af-309e-47a4-99df-f7ee33e57f6f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.633580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a31af-309e-47a4-99df-f7ee33e57f6f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.635721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 281/551] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:57.636596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a31af-309e-47a4-99df-f7ee33e57f6f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d46f5abb-f129-402d-aa67-74a9fc42b2cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:57.641103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:57.642244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:07:57.644253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:57.647193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 271/552] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:57.648578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.649004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.649401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.656580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.671198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:57.672667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:57.764705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a31af-309e-47a4-99df-f7ee33e57f6f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.765944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 272/553] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:57.767030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.822804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.823670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.824563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.825132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.826069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.826519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.828842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.845817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 282/554] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.845817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:57.848123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.905309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730db2e-4830-447d-a5ec-d56a089401b8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.948484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:57.958005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:57.958891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:57.959268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea2d48-9b19-42e6-92d2-5b6d09c2f9b6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:57.959919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:57.960388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:57.962197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:57.962499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:57.963963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:57.992140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 273/555] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:57.993324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.002271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.003478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.003749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.004010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.015231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:58.021253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.022191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:58.023034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:58.027338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 283/556] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.028093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.092489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.112974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42ea66-d5d4-4dd1-8ca0-c052d93b94df None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.132812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed8b3-e7ef-4322-8646-ace9f38962e4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.151682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.152598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.153204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.153676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.165795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.167588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.168002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.168918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.169284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.169642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:58.184889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.186366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:58.187239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:58.187239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.187239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:58.194280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 274/557] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.195380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.239594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.241180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.244365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.302039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.314320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1612-1b7f-45cf-8127-ca95e7a40b03 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.342496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 284/558] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:07:58.347933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.353019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.353848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.354318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.354732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.355541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.355987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.357622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.367888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 275/559] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.369075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.454221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd65329-29c1-45fe-a1b1-4323ef6dcc85 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.480343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6eb8-3e4f-46af-8b4b-1dc1902339a4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.483405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.489391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.490019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.490295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.490560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.491195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.491495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.492845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.504866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 285/560] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.506270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.530164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.531227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.531831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.532373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.533512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.548005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.550471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:58.566464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.567431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:58.568343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:58.568343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.568343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:58.570661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 276/561] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.571761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.617471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1355a-a246-4519-ad92-84c904d31227 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.652482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.653127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.653460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.653654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.664600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.666224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:58.681097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.682232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:58.683108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:58.683108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:58.683108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:58.683108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 286/562] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.683343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.698291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394eacb-b1af-4fa9-bcb9-7d11dd8dabfc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.734287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.734827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.735105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.735376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.744313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.746596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-30168bfd-468c-411b-8e6a-aa12bc8038f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:58.760114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:58.761458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:58.762419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 277/563] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:58.763002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fb3d-3e28-46e6-b058-fe6f2de0e919 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.763251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fb3d-3e28-46e6-b058-fe6f2de0e919 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.763524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fb3d-3e28-46e6-b058-fe6f2de0e919 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.764904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 278/564] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:58.765510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fb3d-3e28-46e6-b058-fe6f2de0e919 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.770620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.790805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:58.801624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae88f-0be6-4b10-81c2-3af11272bef7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.836505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.837100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.837371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.837633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.838287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.838581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.839956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.852937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 287/565] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.858021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:58.887129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fb3d-3e28-46e6-b058-fe6f2de0e919 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:58.925376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:58.926150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.926329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.926558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.927263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:58.927482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:58.928995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0300b-7a9f-49c7-aae7-9c0a0ad87308 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:58.945111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 279/566] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:58.945111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:58.945111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:58.945111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:58.961169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:58.962397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:58.969355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28db4b2-c1e2-4449-a129-1a604eb62772 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.004647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.005175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.005451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.005717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.006458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.006757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.008152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.009726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.027470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 288/567] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:07:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.028534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.033129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 280/568] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:59.034007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.041852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.138419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6ca2-02c7-466c-820d-b238657324b3 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.140323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ef249-ad0a-4198-a878-dc8a4107926b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.172311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.172938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.173212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.173307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.173481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.173821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.174120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.174926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.181268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.181435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.182733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.182836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:07:59.194428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.195550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:07:59.196693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-95b3b34d-4175-4698-a27f-43f993d51415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:07:59.197336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.198327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 289/569] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962f6e-2e3c-491a-9a7b-be167c7579cc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.204407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962f6e-2e3c-491a-9a7b-be167c7579cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.205178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26962f6e-2e3c-491a-9a7b-be167c7579cc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.205178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 290/570] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:07:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:07:59.205178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962f6e-2e3c-491a-9a7b-be167c7579cc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.205441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 281/571] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.205441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.255089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.266867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.302914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08af9d-0a41-44b1-8e9e-654f5cd99bd8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.303920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26962f6e-2e3c-491a-9a7b-be167c7579cc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.337102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.337716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.338014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.338278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.342242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.342861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.343293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.343561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.348465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:07:59.353268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:07:59.353662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.354741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:07:59.355759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:59.356549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.356630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 282/572] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.356630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:59.374371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.375514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:59.376868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:59.376868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.376868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:07:59.376868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 291/573] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.376868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.462379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23b089-c4a4-4c11-9470-13c9e2b51152 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.485580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edfe98-8804-4496-9b86-3e883cb66013 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.488543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.488982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.498304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.498907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.499185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.499453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.500135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.500435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.501866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502e5b-759f-45ef-971a-b45154ad3b0b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.513776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 283/574] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.514961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.515245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.515513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.525248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.525851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.526192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.526422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.527185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.527494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.529433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.534216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:07:59.535411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:07:59.547287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 292/575] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.548092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.603797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 284/576] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:07:59.604744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.651336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da26794-eb9a-49b4-8a4f-aaa651e67590 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.684223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.684824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.685102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.685373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.686061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.686363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.687779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.696339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 293/577] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.696960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.700493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ec4e8-62a0-4f6e-b183-aeb2015ce78d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.716977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.723187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.735355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.735959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.736236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.736507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.737201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.737501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.738901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.749721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 285/578] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.750533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.802102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8c062-d2b4-44c4-b428-db4eceb1a501 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.835352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.836025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.836299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.836564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.837274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=b88b0656b52c4945896874a40739b5e8) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:07:59.837575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.839031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.844394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 294/579] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/role_assignments?user.id=b88b0656b52c4945896874a40739b5e8&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:07:59.845228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.855939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac6bff-8509-43b1-af15-60c37474cb38 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.904799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:07:59.905454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:07:59.905734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:07:59.906054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:07:59.917927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:07:59.919440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:07:59.935184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:07:59.936738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:07:59.937611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:07:59.937611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:07:59.937611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:07:59.937611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 286/580] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:07:59.937611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:07:59.953378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:07:59.967296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fbf78-183b-46ce-91ba-638003661630 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:07:59.975035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.007619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.008233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.008516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.008787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.021882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:00.027852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.029007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:00.030077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:00.034099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 295/581] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.034952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.064797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8fb6-295a-4f8d-b6c8-31ac42784a94 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.099226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.099856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.100136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.100502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.111462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.113456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:00.128332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.129348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:00.130289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:00.130289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.130289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:00.130289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 287/582] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.130289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.147691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b0034-c90b-45f1-a350-31a85a20e49b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.182627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.183236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.183506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.183819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.190621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.192056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:00.202938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.203818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:00.204697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 296/583] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.205201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.216372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.221956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.242857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4e5e0-20a3-45ae-85c6-36e221b46702 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.277761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.278393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.278671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.278942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.279586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.279884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.281243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.295332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 288/584] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.296305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.316820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd8b0b-38e9-4893-bc1f-03a6306d7399 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.356301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.357154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.357434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.357731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.358604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.358714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.360045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.372919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 297/585] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.372919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.406315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392980-6baa-4d82-bb2d-0fa3ad5f7b1d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.441786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.442409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.442679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.442943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.443572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.443865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.444751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.445208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.454559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.463830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 289/586] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.464679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.481332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e074-f055-47d0-81e9-c76e0ceb7b29 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.516970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.517573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.517845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.518725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.519404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:00.519703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.521100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.538705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 298/587] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:00.538705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.578415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8b71-3cc2-4303-86bf-5cfc602845db None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.616091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.616714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.616984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.617246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.623924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.625504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:00.636644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.637735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 290/588] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.638665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.649632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e13-3437-40d8-b593-ad229a1225ff None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.680806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.687213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.687970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.688345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.688708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.698573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.700112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.704499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:00.715907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.717040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:00.718121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:00.718121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:00.718121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:00.721883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 299/589] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.722719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.754991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d477-afc5-49f5-a782-746ca551b5e9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.790100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.791100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.791452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.791711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.799958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.801372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:00.812990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:00.813945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:00.815549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 291/590] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:00.819978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.823353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45424-569c-49d6-8d1f-26b458de3275 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.861437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:00.862829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:00.862991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:00.863251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/06607bda2bed4773af2dce7a16b5c141/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:00.880924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=06607bda2bed4773af2dce7a16b5c141, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:00.882761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:00.899725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 300/591] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:00 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/06607bda2bed4773af2dce7a16b5c141/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:00.900612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:00.951875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:00.954164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b1c1-2ef1-466e-8949-59d50710a8c8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:00.977061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.001605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.002955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.003304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.003695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.004508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.004913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.007218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.030468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 292/592] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.030468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.040274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb543c-2ea8-4899-b431-554e26b2ce2e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.096473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.097237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.097611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.098013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.098768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.099156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.100646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.112641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 301/593] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.114066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.156474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780dd75-4d59-4749-b34b-1ee2fb626199 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.192557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.193470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.193852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.194259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.195583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.196075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.198108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.222992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 293/594] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.228777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.231579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.242475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d43d0f-8247-4d5d-976b-e98848a85b6a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.274636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.280868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.281784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.282185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.282586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.300317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=c221970fdea24fa5997ab29aa35c2f75, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.301999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.320063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 302/595] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:01 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:01.321568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.346698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ddce-c881-4cbb-bec1-4c91041a69d7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.394061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.395358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.395760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.396133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.406967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.409067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:01.428023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.429204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:01.430425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:01.433991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 294/596] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.439055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.454822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8a71b-a3d3-47fc-a048-e76f8b39f04f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.499170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.499964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.500368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.500742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.514341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.516267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.519721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:01.539645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.540662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:01.541692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:01.541692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.541692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:01.544356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 303/597] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.552436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.614962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.619315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cfa4-dc35-4f7e-9b1b-5c0bf5e37377 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.659438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.660065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.660427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.660986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.661559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.661970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.663492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.686143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 295/598] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.690496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.716613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1903c0-5d31-4f9f-affc-5e3716a0d373 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.755627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.756621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.757180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.757756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.758624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:01.759142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.760703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.774619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 304/599] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:01.780661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.803691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d731-4380-456a-8dc9-69fad48ace0f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.848930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.849596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.849866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.850150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.857750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.873003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.874508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-bd586d46-2c5d-414f-950f-e2f9cf9a5b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:01.892223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.893231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:01.894991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:01.894991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:01.894991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:01.898474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 296/600] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:01.899842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd632cb-e927-4a0f-a6a3-3a840ce204f9 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.900127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd632cb-e927-4a0f-a6a3-3a840ce204f9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.900398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd632cb-e927-4a0f-a6a3-3a840ce204f9 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.905894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 297/601] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:01.906821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd632cb-e927-4a0f-a6a3-3a840ce204f9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:01.919699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:01.921719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d8f4-d87e-4f76-985c-c8f14d69a8c4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:01.968159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:01.969148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:01.969631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:01.970186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:01.981022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:01.983549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-31d771dc-335f-4335-aa70-9815f6503427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:01.998180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:01.999089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:01.999986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:02.003347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 305/602] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.005095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.005776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.006228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.027814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:02.029132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:02.031494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd632cb-e927-4a0f-a6a3-3a840ce204f9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.068613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.069497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.069945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.070356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.071139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.071581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.073101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.085392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 298/603] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.087236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.118223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 306/604] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:02.120027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.182505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.184825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.227796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f373-4bca-40f0-927c-1c7e24d5755e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.246568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7d2f2-bc65-4096-a8e9-67c4afa493cc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.274666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.275698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.276042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.276382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.277144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.277642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.279773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.283376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.284271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.284817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.285261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.292649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.294041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 299/605] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.294800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.295109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:02.308352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.309285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:02.310197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:02.312842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 307/606] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.313793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.421529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023583-f6db-49ce-8282-e4840fc8b279 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.426962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b1bc7-0f4c-471a-9a2d-db58faa2eed0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.456572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.460562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.468872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.469832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.470329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.470700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.471488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.471679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/21b6715254e34797a3af9b291d26b1dd/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.472074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.472494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.483330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:02.488980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.490224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:02.491270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:02.492234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=21b6715254e34797a3af9b291d26b1dd, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.493713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 300/607] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.493828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.494843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.512358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 308/608] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:02 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/21b6715254e34797a3af9b291d26b1dd/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:02.513381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.628763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82643598-aa48-42bb-8369-f90f63e511c7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.640766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d845-3d26-492a-b83e-0d9483cc5dfb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.674993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.675993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.676338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.676674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.677648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.678061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.680228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.683855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.684771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.685227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.685673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.686594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:02.687223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.688809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.699221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 309/609] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.700992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 301/610] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:02.710015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.711164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:02.758297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.771804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:02.832427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc356ce-cbb5-49fa-91d2-a4aff5d00df6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.851244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6f77-c11b-4919-9d7c-11f3a37adf4c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:02.868127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.868783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.869060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.869332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/45b5ef7c1c6a4698bd122c8d7327c723/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.901977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=45b5ef7c1c6a4698bd122c8d7327c723, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.903431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.916095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:02.916788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:02.917066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:02.917330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:02.927322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 302/611] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:02 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/45b5ef7c1c6a4698bd122c8d7327c723/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:02.943139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:02.944690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:02.966588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:02.967575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:02.968473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:02.968473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:02.968473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:02.974474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 310/612] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:02.979803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.118860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.126001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12b9a4-28c6-4ea0-a63c-c721a009de8d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.175878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.176508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.176846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.177118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.177768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.178089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.179533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a6f9-5678-4fc1-9e41-f3e367c2d282 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.196896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 303/613] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:03.202357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.293396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.332396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ac21-d616-46f4-9c91-7937fba9d1af None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.369058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.370096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.370579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.371049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.376425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b689f3-e18b-451e-8fd0-4859a2d04b68 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.376705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b689f3-e18b-451e-8fd0-4859a2d04b68 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.376972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b689f3-e18b-451e-8fd0-4859a2d04b68 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.378988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 304/614] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:03.380773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.382452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.384588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.384875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.385149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:03.396594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.397584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:03.398569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:03.401185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 311/615] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:03.407238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.422885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:03.424110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:03.522862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd44103-f882-4c5d-8506-e90b68fcbb82 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.545471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 305/616] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:03.562301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.568571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.569200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.569478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.573303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.574116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:03.574435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.576156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.599486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 312/617] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:03.605017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.623834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.718348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:03.724229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec10e2-edc8-4c37-824c-74df93feb960 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.789472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.790132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.790407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.790672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.816068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:03.817454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5d46b1cc-fd30-44d5-a4bf-71752445e260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:03.836034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.837103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:03.838049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:03.838049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:03.838049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:03.838049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 306/618] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:03.843484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936f74-6a29-45ac-bbcd-13f15e2dab6c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.843766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936f74-6a29-45ac-bbcd-13f15e2dab6c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.844042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936f74-6a29-45ac-bbcd-13f15e2dab6c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.847362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 307/619] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:03.848107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936f74-6a29-45ac-bbcd-13f15e2dab6c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:03.859826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63daa9d-075c-4b28-b667-c18d4bcdcf2b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:03.911096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:03.912310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.912852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.913120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.923583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5f916ef5-03c0-4e5a-b922-21eacd2a99cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:03.928899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:03.929846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:03.931105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:03.935524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 313/620] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:03.936882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:03.937261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:03.937636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:03.957258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:03.958693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:03.997748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936f74-6a29-45ac-bbcd-13f15e2dab6c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.006706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.034962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 314/621] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:04.036099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.058447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.059054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.059326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.059594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.060234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.061321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.062991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.076382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.082448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 308/622] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.083967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.179251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9241ab2-89fb-4173-a675-6f095f98f6a3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.214951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.215552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.215654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.215922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.216576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.216872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.218439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.226777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 315/623] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.227430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.231286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e7c20-b4c2-4d2d-acc6-59b5454833c0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.274012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.279905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.280808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.281462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.281963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.296690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:04.303623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.304563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:04.305417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:04.311991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 309/624] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.311991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.360323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115cd88-a9c6-4dfa-af81-ac7e5ca6def3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.382957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.399641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.400592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.401083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.401546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.410524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.412509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:04.427076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.428066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:04.428965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:04.437706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 316/625] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.438717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ad1-7f51-4b72-93ed-3eaebb284b6e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.439152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.484215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.485037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.485411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.485781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.503858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.505300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:04.523014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.524331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:04.525318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:04.525318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.525318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:04.525318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 310/626] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.525318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.566905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.572288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54fcb-a981-4549-b7d6-07af45e4abd5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.617837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.618729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.619158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.619587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.620754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.621228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.623329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.641469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 317/627] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.641469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.658130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe31f-8942-4beb-978e-4066a3b4698a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.679127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.703161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.703765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.704046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.704308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.704986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.705315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.706793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.719423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 311/628] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.720298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.773177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd47e-33fa-4e8a-bd58-9ee527d15b44 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.809727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.810422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.810701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.811178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.812176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:04.812176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.813449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.831647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 318/629] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:04.832517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.851580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06f1a-61a5-4af9-8033-f23a18b5fb3b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.856020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.899957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.900585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.900862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.901126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:04.911959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:04.913616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:04.928454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:04.929427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:04.930354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:04.930354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:04.930354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:04.930354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 312/630] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:04.930354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:04.949225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353365f4-e76f-4cd1-a4cb-6d93f944d1bc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:04.958434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:04.985554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:04.986238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:04.986580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:04.986854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/b88b0656b52c4945896874a40739b5e8/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.002682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=b88b0656b52c4945896874a40739b5e8, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.004118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5fa35-e7ec-48cd-9921-1a1a3a57f871 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.021416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 319/631] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:04 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/b88b0656b52c4945896874a40739b5e8/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:05.022804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c71b8-8431-4c2b-9dfc-c42c2d0a784f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.023143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c71b8-8431-4c2b-9dfc-c42c2d0a784f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.023417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c71b8-8431-4c2b-9dfc-c42c2d0a784f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.024918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 320/632] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:05.029754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c71b8-8431-4c2b-9dfc-c42c2d0a784f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.058216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629595-0d8a-4965-957f-161ce0c2b3b3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.101474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.102464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.102930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.103457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.113599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.115624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.130955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-354b1adb-a85a-45d2-a050-dd7c27e849b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:05.132086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.133228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 18:08:05.134304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:05.141931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 313/633] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.144039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.144940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.145409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.167279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:05.168744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c71b8-8431-4c2b-9dfc-c42c2d0a784f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.169193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:05.214960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.215625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.215909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.216178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.216822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.217123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.219103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.235484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 321/634] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.237132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.247148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 314/635] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:05.248646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.264150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.365721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f406-ce5f-4b9f-af00-aebd6ea12705 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.366146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b646f7-66e9-4d6c-b01c-5157f66908cd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.397805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.403450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.404081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.404357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.404624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.404801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.405462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.405803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.406151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.406930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.407301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.408791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.412914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.414457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.430777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 322/636] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-52f9c34a-bfb0-4eb9-8a64-8f54b6691e11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:05.430960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.431843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:05.432851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:05.433491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.433573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 315/637] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.434196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b660de-1d88-4d90-97c1-e2ec051efe56 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.434421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b660de-1d88-4d90-97c1-e2ec051efe56 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.434690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b660de-1d88-4d90-97c1-e2ec051efe56 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.436037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 316/638] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:05.438002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b660de-1d88-4d90-97c1-e2ec051efe56 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.529419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.541801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2577c-3b85-4cc7-b97d-00d5261c5192 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.559617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b660de-1d88-4d90-97c1-e2ec051efe56 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.576514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.577141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.577418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.577680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.587624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:05.592230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:05.593315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 323/639] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:05.594285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.599524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.600136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.600436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.600779 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.645290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.673495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.674972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.697230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300372-7ed7-4223-9edb-ef05e18aa423 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.732330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.733009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.733352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.733701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.734501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.734801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.736209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8a48-ca06-485b-a6af-5033362b50ba None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.750623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.757929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 324/640] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.757929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.757929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.757929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.773049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:05.774292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:05.791014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 317/641] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:05.791986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.842012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 325/642] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:05.842859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.881164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:05.907439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f29c-1fb1-4c82-b46b-620817857e87 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.942339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.942945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.943389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.943712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.944519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:05.944879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:05.946364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:05.952322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a76ca-97f4-4c04-9423-6aa81f28af70 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:05.955039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 318/643] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:05.960819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:05.986029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:05.986774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:05.987044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:05.987314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:05.996928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.058904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.060498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.067608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b3cb0-9313-418c-afaf-ec7ed544dff7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.094143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.105076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.105818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.106213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.106574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.117117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.118685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:06.132318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.133529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:06.134649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:06.134649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.134649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:06.135621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 319/644] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.140698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.172343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 326/645] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:06.172343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.233598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.245835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b79b7-4a17-442e-bf62-237e54552838 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.278840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.279495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.279722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.279992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.285569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bba3-355d-46d9-9c37-a60a7e0ccdd9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.290515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:06.295563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.296766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:06.297868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:06.301603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 320/646] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.302475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.324347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.325003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.325281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.325544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.328393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.337594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.339124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:06.353854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.359510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:06.360650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:06.360650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.360650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:06.360650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 327/647] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.360650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.411471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38658-dfa0-455d-8955-cf6f42aae789 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.444195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.444781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.445053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.445316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.445966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.446261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.447616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.459488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 321/648] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.462364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af761-564f-43ae-b4a5-5e6e22a1442a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.462952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.474919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.499775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.500869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.500869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.501062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.512242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.513760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:06.527974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.529109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:06.530242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:06.530242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:06.530242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:06.530665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 328/649] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.536539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.574470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794de0-d608-4043-bd74-b2a0a3cfd258 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.581239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.609093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.609773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.610142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.610474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.611196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.612085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.614093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.622195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 322/650] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.627343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.645549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0831-a0e1-4136-8040-495824e63a47 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.681221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.682486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.682767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.683316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.683958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.684257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.686164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.700958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 329/651] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.702773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.715457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.748643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce40f-f732-439d-8975-c29e6b3f7e07 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.784924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.785769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.786224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.786630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.793833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.795460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.806812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:06.809534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:06.810455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:06.811959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:06.812380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb1d5-cc5d-414e-a488-571abeb77210 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.812461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 323/652] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:06.812461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.849400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.850119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.850471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.850810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.851515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:06.851879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.853231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:06.869636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 330/653] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:06.869636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:06.934711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d7b5-b781-4b77-b5e2-dfb10782dca0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.963441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:06.970443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:06.971852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:06.972194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:06.972525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:06.976204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c80cb-a959-4ed7-9bc5-5864affdf59a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:06.984701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:06.987074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:07.001524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.003224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:07.004325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:07.004325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:07.004325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:07.005119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 324/654] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:07.005822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.016890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.017581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.018002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.018584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.026640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.028363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:07.040030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 18:08:07.042286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:07.043074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 331/655] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:07.043888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.068287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.118970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95486-b833-4ca2-bf63-827e85570e44 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.145987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee35b-174b-454a-bae6-7dea92a566ec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.152649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.153249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.153518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.153781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.154498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.154823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.156229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.167735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 325/656] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.168602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.183015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.183724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.184002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.184272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.191326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.192732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:07.203564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.204605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:07.205587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 332/657] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:07.206097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.211886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.267613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f78e7-fd7f-458d-a163-5e780a8022df None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.286456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.302018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.302556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.302834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.303101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.303736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.304063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.305372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ece74-2c8e-4ce2-a245-283a09e23a6b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.305934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49409faf-3e48-47e8-ac2d-4eaec131c896 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.316879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 326/658] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.318066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d87a55-f92d-45a9-9fb9-822394ea6e2e None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.318346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d87a55-f92d-45a9-9fb9-822394ea6e2e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.318619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d87a55-f92d-45a9-9fb9-822394ea6e2e None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.321450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 327/659] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:07.321450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d87a55-f92d-45a9-9fb9-822394ea6e2e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.342781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.343379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.343654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.343918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.344626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.344925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.346388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.363708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 333/660] 10.222.0.30 () {56 vars in 1139 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.364497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.422326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d87a55-f92d-45a9-9fb9-822394ea6e2e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.424347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.457850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.458474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.458748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.459014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.459724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=06607bda2bed4773af2dce7a16b5c141) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.460027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.460116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7190-80fa-44f8-8539-9f2848bb7491 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.461441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.467155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 328/661] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/role_assignments?user.id=06607bda2bed4773af2dce7a16b5c141&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.467924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.500766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.501413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.501693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.502590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.503273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.503609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.505036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd254-8346-4560-8eee-d2bc96891403 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.513055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.522797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 334/662] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.524930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.525540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.525931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.545486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:07.546827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:07.585277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6136271-226b-42c1-aeb2-ca07bbd404bd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.621447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 335/663] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:07.626942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.627125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.627668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.627958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.628205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.637294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.638837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:07.651076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:07.652053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 329/664] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:07.652994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.743860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005575-59cf-4daa-ac47-bdca72703c98 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.772338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.781501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.782218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.782564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.782904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.802425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:07.860191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.861863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.896188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633b34-f746-4a91-81b6-c9447de0f4a7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:07.933581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:07.934370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:07.934777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:07.935147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:07.936019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:07.936501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:07.937971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:07.953948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 330/665] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:07.953948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:07.985838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 336/666] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:07.987043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.021123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.081415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.095236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ab57b-6941-4351-81a9-b9a85fb572a5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.105681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e198a8-74d6-405e-b845-a64600496b1e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.140999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.141741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.142092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.142368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.146805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.146805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.147035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.147118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.147911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.148186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.149523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.156501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:08.161579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.162737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:08.163592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 331/667] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:08.164281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.175048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 337/668] 10.222.0.30 () {56 vars in 1137 bytes} [Sun Aug 7 18:08:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.177091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.286923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.296033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e4233-227e-4235-8af0-74c4f95f339a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.303489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a8983-a1d1-40b5-b3b3-36af59205a13 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.339973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.340605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.340905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.341179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.341867 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.342198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.343587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.346992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.347637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.347910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.348176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.356009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 338/669] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.357116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.362324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.363930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:08.380508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.381703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:08.382827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:08.382827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.382827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:08.384678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 332/670] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:08.385773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.388918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.517069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c7ca-e4b0-474f-820d-977737787a17 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.559826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.560452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.560726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.560990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.574718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.576431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.587447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226a1f-0d7a-4b3f-93e8-224ac1461d61 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:08.593099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:08.594082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:08.595079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:08.595079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:08.595079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:08.597366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 333/671] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:08.598357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.634940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.635714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.636039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.636310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.659446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.659643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.715513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410bc21-c133-4c6c-8ba0-de54bef7c542 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.731183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.732879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.751123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.752465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.752886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.753339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.754223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.754713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.756223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.770752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 334/672] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.771830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.854023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 339/673] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:08.855262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.897689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332922c2-71a8-4f40-a456-c1329b8f9bbe None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:08.915500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.918635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:08.941656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:08.942454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:08.942738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:08.943006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:08.944401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:08.944713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:08.946099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:08.959856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 335/674] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:08.962006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:08.983017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83acaf3-ced8-4616-9d88-5d6a4e9e0de4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.026755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.027306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.027594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.028170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.036681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.038299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:09.052228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.053161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:09.054082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:09.057971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 340/675] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.058933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.083296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045711d3-cf92-4140-8871-39cfc70c8537 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.120523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.121202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.121482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.121751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.133350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.135161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:09.151085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.152073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:09.152951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:09.152951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:09.152951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:09.156769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 336/676] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.157619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.184082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae346-6535-4f02-b624-2c1df4614829 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.193074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.194789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.225431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.226133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.226410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.226676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.236019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.238263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:09.253690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.254717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:09.255657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:09.263360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 341/677] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.263360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.297002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5219cd-ac55-4c53-adc7-65c762518159 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.343043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.344547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.345037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.345504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.347416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.348691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.350865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.373041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 337/678] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.373041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.375530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a5a1-8ac0-4624-b179-fd5598dda934 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.418146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.419081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.419818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.420303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.422054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.422564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.424196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.441140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 342/679] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.442398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.478993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.480117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.499760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af401ad-5d46-427f-aa0a-a6408e62c6f9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.547676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.548921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.549381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.550104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.551432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.552149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.554411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.559771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b805f2-3be9-4e22-8498-08738a647593 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.579358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 338/680] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.580645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.601459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.602177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.602563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.602977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.603744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=21b6715254e34797a3af9b291d26b1dd) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:09.604357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.605628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.612229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 343/681] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/role_assignments?user.id=21b6715254e34797a3af9b291d26b1dd&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:09.612837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:09.705879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe0d9-bc9d-42f5-b26b-f775d107fb42 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.741929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.753924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38c8cd-afd6-4372-b301-62a4723da8e5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:09.757309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.758370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.758854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.759341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.769466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.772031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0208ce69-9eac-4dfb-ada9-9e7bec93199f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:09.785432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:09.786393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:09.787279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:09.789013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 339/682] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:09.790395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c316c8-63cf-43d4-a2be-367e9c11864a None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.790900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c316c8-63cf-43d4-a2be-367e9c11864a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.791168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c316c8-63cf-43d4-a2be-367e9c11864a None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.792531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 340/683] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:09.799938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.800182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.800427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.804324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:09.805174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:09.805668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:09.806241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:09.809245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:09.822246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:09.823430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:09.899370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:09.900969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:09.902392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 341/684] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:09.909931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.025724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580c7bd-64f9-4a35-bfa0-451b8c0dc163 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.035952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.050026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 344/685] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:10.051337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.065205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.066017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.066391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.066752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.067628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.068021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.069595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.071477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.086348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 342/686] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.087374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.173929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2900905-6864-4850-8add-5e8d8d085d7c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.203372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c6877-95e0-46a9-88b3-1e409b5c74d1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.213518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.214495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.214784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.215295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.226906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.229296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.238591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.239225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.239502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.239769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:10.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.248798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:10.249710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:10.249710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.249710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:10.255903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.256180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 345/687] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.256180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.256479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9a86ce67-35af-4786-b822-11ddf97b122d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:10.275701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.276819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:10.277812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:10.277812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:10.277812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:10.277812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 343/688] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.278093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8cf3-3d05-410c-91bb-b33429f5620d None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.278793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8cf3-3d05-410c-91bb-b33429f5620d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.279127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8cf3-3d05-410c-91bb-b33429f5620d None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.281943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 344/689] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:10.281943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8cf3-3d05-410c-91bb-b33429f5620d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.310076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.335695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.371219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9fee-866e-4fb1-9d3a-dbbaf133a9ac None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.397770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8cf3-3d05-410c-91bb-b33429f5620d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.405383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.406020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.406295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.406564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.407295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=45b5ef7c1c6a4698bd122c8d7327c723) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.407596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.409127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.414947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 346/690] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/role_assignments?user.id=45b5ef7c1c6a4698bd122c8d7327c723&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.415733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.447005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.448056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.448571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.449120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.450135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.450635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.452440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c91e4-7327-4d43-9a4e-ad45a3b5a7f3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.466672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 345/691] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.468372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.468723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.469061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.489618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:10.491115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:10.562019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c3db-2945-4083-96df-127505e3ceb9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.574242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 346/692] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:10.575115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.576556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.609593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.610488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.610928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.611876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.612657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:10.613117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.614517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.623233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.631034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 347/693] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:10.631883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.708182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f6db8-781d-4dce-a484-0f27896ce494 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.746265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d95fb-3176-4a5a-a035-b4c1aafd480a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.753761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.754479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.754821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.755194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.756455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.758446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.785392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.786203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.786795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.786920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 347/694] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:08:10 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:10.787008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.787751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.800983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:10.805981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.806955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:10.807831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 348/695] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:10.813668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:10.882072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.913375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:10.927279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa717f4-a2a3-474b-ae74-5a375b2a05b7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:10.968607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:10.969301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:10.969573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:10.969877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:10.979332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:10.980800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:10.994691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:10.995713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:10.996619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 348/696] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:11.004976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.048918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f0f6-ed9c-40b8-8982-1c13c78f36c6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.094603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.095220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.095526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.095805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.096474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.096837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.098222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.107373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 349/697] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.114217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.164025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270be0-6b98-4fa0-9647-5654ebba37ee None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.213500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.214157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.214428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.214868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.215975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.216276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.218148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.228980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.235414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 349/698] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.241882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.248251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328f7f-bd39-4e50-994b-58389802d25a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.261732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.293384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.294551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.295063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.295540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.308328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.311029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:11.326489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:11.327489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:11.328413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:11.328413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:11.328413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:11.331206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 350/699] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:11.337007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.363768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815939-72a3-4276-b49d-280f87dccf08 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.407799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.409041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.409280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.409498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.410254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=b88b0656b52c4945896874a40739b5e8) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.410560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.412004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.418654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 350/700] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/role_assignments?user.id=b88b0656b52c4945896874a40739b5e8&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.450224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8a6b-076a-46f6-9c80-7b9680c8e7d9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.490927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.492004 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.492503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.492978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.493873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.494444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.496108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.511357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 351/701] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:11.517734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.639908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.666100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bbe0f-f34d-4d67-b6af-80458cebc3af None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.707240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.707869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.708144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.708417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.716613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.718092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:11.731330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:11.732393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:11.733328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:11.739104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 351/702] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:11.739251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.743452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:11.853285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cce4b-c95b-4ae7-ab0d-702ab544e9a6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:11.889426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:11.890145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.890367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.890636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.891367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:11.891674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:11.894048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757a1c-2439-493c-add4-158cc338aab0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:11.912909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 352/703] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:11.918408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:11.939919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe7fb-8e92-417f-9a8e-55c261eb6bd7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.940226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe7fb-8e92-417f-9a8e-55c261eb6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.940464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafe7fb-8e92-417f-9a8e-55c261eb6bd7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.941772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 353/704] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:11.946903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:11.947184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:11.947450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:11.967806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:11.969003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:12.033868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.047462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7a8f4-e053-42d2-b7d4-b29aaed7ee66 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.049074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 354/705] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:08:12.071130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.125250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.125936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.126228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.126506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.134966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.176824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5563b5-f63f-4b07-bd46-d62f92f4b322 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.216397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.217270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.217690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.219514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.220245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.222321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:12.240565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:12.241831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:12.242736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:12.243468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 355/706] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:12.249463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.269605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.271403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.330033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.412127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68ce63-bdcb-4e4d-b1f3-1b2ac5a3aac4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.450218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.451179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.452160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.452636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.453491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] RBAC: Adding query filter params (name=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.454046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.455969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.461262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 356/707] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:12.467326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.496985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 352/708] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:12.502545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.590068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb618c-fa99-43e1-ad5c-35c9269ca157 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.609676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.615777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:12.632604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.633214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.633493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.633764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.634471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] RBAC: Adding query filter params (type=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.634777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.636123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.643431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 357/709] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:12.708933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bb59b-b654-4ef7-be56-c0a8265d9d36 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.749184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.749826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.750138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.750406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.762335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.763829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-fe1abea2-f160-4291-9093-1b8abe19d0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:12.781078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:12.782128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:12.783093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:12.783093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:12.783093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:12.783093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 353/710] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:12.788417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:12.900955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c3ce2-6446-4199-b49e-d94fbeb58a05 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:12.920458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c5298-1c0e-4198-8a4b-46f4a9d70be5 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.920742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c5298-1c0e-4198-8a4b-46f4a9d70be5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.921000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c5298-1c0e-4198-8a4b-46f4a9d70be5 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.922604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 354/711] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:12.932162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.932695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.933202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.943803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:12.944416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:12.944694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:12.944965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:12.945677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:12.946014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:12.947378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:12.954885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:12.956328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:12.965285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 358/712] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:12.968223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.027082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.034040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 355/713] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:08:13.051931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.074263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.096889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c90f-c1ec-4c1c-a5c0-dabd3469eec6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.133010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.133651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.133943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.134216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.141448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.143783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:13.155653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:13.156610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:13.158232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 359/714] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:13.162991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.178404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab78a-2a75-4c9e-af56-88eb2a8d6e25 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.221182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.222479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.222975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.223455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.224230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.225802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:13.238621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:13.239669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:13.240494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:13.246527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 356/715] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:13.250238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.342294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.360360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e2d8-1a8e-4edf-bfb7-fe1a4acbe677 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.400191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.401785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.402471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.403877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.404895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:13.406160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.408326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.411562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df43ee-fd54-4ac5-a25e-1f6b462c6fd5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.413999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.417752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 357/716] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:13.426419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.477750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.479064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.479593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.480056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.480997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:13.483581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.485243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.510113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 360/717] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:13.516080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.613268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee019-4678-4d4f-8bf9-48aaa62882d9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.651722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86d97-11d2-4816-bf60-b8a073d82a57 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:13.655560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.656171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.656547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.656809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.657436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:13.657729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.659738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33387233-ac04-476d-9b88-37acdc17a6a1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.667218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 358/718] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:13.668674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad91a-9db6-43bd-b655-11f0a9be738e None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.668951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad91a-9db6-43bd-b655-11f0a9be738e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.669220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad91a-9db6-43bd-b655-11f0a9be738e None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.673988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 359/719] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:13.676543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.678219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.678886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.700709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:13.702411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:13.706541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.718632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:13.719250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:13.719631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:13.719822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:13.721036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:13.721338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:13.722797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:13.736329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 361/720] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:13.786147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 360/721] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 18:08:13.823169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:13.867454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:13.975416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15932-51a8-4888-9117-67d8e8541984 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.014306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.014856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.015134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.015400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.026071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:14.031206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:14.032148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:14.034070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 362/722] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:14.038578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.155004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df715-ae43-44df-9ce0-3201d889d46e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.202295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.202904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.203181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.203451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.204111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:14.204411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.206340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494af7f-37e1-4e9d-a637-407452052351 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.216996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 361/723] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:14.222284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.238504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ef5e-55c3-4a73-a07e-79f8683474db None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.238796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ef5e-55c3-4a73-a07e-79f8683474db None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.239049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ef5e-55c3-4a73-a07e-79f8683474db None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.240617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 362/724] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:14.246511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.246951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.247283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.266687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:14.269141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:14.272729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.398254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.408110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:14.421573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6916825-5c29-41e2-a46e-d3e529cff6eb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.456880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.473153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.473790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.474093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.474360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.497640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.499116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:14.523182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:14.524213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:14.524213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:14.524213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:14.526095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 363/726] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:14.531587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.633942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24270-fec0-428c-8c23-f17c14093ccb None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.671290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83865d-fa25-4e19-b55c-f29cf218bc7d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.697130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.707462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.708107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.708386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.708652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.719805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.720442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.720719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.720985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.721627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:14.721942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.723309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:14.727551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:14.732275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:14.733185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:14.734054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 364/727] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:14.742879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.743979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:14.750081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 364/728] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:14.755778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:14.918451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee8b7c-3a41-4789-9b62-61bd3c29061c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.962291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771702f5-df50-4455-b4d8-bd5d7feda01c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:14.991973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:14.992589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:14.992858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:14.993119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:14.993788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:14.996680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:14.998101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.014143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 365/729] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.021275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.039689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.040329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.040604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.040871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.054752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.059287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:15.076385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:15.077374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:15.078321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:15.090483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 365/730] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:15.096383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.102282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.181036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0a404-b098-4f3d-b7a0-c34f21923d59 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.194268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.226130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.226756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.227029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.227295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.238007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b611b64-c8a1-4a87-bf40-8af4f7807969 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.239204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.240854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-7c8bc358-d34e-4663-9d46-a34cb4b8e525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:15.257777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:15.258815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:15.259732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:15.259732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:15.259732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:15.262065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 366/731] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:15.263435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3616-5b55-4d69-b09c-bc9cee9b9c60 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.263709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3616-5b55-4d69-b09c-bc9cee9b9c60 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.263979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3616-5b55-4d69-b09c-bc9cee9b9c60 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.265295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 367/732] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:15.266023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3616-5b55-4d69-b09c-bc9cee9b9c60 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.282463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.283612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.283886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.284145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.285006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.285313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.286795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466c25-a364-416e-8c6c-7ad37523ec49 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.307852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 366/733] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:15.309103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.309381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.309651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:15.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:15.404030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3616-5b55-4d69-b09c-bc9cee9b9c60 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.413022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.424157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 367/734] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:15.425366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.441892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.442705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.442705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.442985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.443673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.443966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.445320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.457258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 368/735] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.462508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.477371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.536109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105445d-ca5c-458c-9a25-1fdf587ab079 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.573962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.574933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.575352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.575851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.583525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d96a0-e72a-4072-bd59-a37f6f111c4c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.619827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.620565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.620901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.621238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.629741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.631537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:15.644332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:15.645755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 369/736] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:15.646742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.655646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.657405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.676929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.709391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.756777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2786a9c-291d-4f19-b2af-95618eac627c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.772731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 368/737] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 18:08:15.772731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.799184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.800101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.800536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.800956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.801742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.803488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.824658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 370/738] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:15 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:15.825812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:15.880044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337908de-6c4d-4d7c-9d3e-daf6cff0be72 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.927705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.934541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:15.935773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:15.936623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:15.936965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:15.938059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:15.938347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:15.940432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:15.949207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35ef44-e283-427c-b431-bb5365394bfe None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:15.957794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:15.961984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 369/739] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:15.967853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.041639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.042586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.043114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.043549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.071132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.072887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:16.095100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:16.096611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:16.097496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:16.097496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:16.097496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:16.097496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 371/740] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:16.098200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551d2a3-e8b4-43c4-acae-5e8d3399e875 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.103673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.138683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.139297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.139574 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.139843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.212625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.214895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.216509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8142e5-a4c7-47c2-84f6-0af58c65b708 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.216640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc1134-9596-4aee-a769-59d06eb83ffb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.251396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.252123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.252396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.252660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.253294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:16.253586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.254975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3c2b-4b87-4a94-b1ff-24eca2c39ed7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.261884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.267915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 372/741] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:16.269974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da863ec-70e0-4a82-9f69-f8dd41612d9c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.270409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da863ec-70e0-4a82-9f69-f8dd41612d9c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.270849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da863ec-70e0-4a82-9f69-f8dd41612d9c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.272649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 373/742] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:16.274175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25ea7-e143-45b1-90ca-60ae08795c20 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.274768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25ea7-e143-45b1-90ca-60ae08795c20 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.275189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d25ea7-e143-45b1-90ca-60ae08795c20 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.277196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 374/743] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:16.278230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25ea7-e143-45b1-90ca-60ae08795c20 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.322592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 370/744] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:15 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 18:08:16.324101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82680-e78f-4648-b95c-2d5bf55d36ac None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.324381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82680-e78f-4648-b95c-2d5bf55d36ac None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.324650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82680-e78f-4648-b95c-2d5bf55d36ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.342906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-84d82680-e78f-4648-b95c-2d5bf55d36ac None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:16.344064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84d82680-e78f-4648-b95c-2d5bf55d36ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:16.392482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d25ea7-e143-45b1-90ca-60ae08795c20 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.425921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 371/745] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:16.425921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.425921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.425921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.429577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.430305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.430584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.430856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.438530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.440042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.444153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:16.445310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:16.451546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:16.452536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:16.453456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:16.457728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 375/746] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:16.458553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.472929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.529926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 372/747] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 18:08:16.529926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.532475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.582391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b6f37-f959-4362-8af3-09fb8a3a28fd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.618334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.618963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.619240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.619513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.629813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103207-19f1-4b35-bdaf-29501df69bb9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.631918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.634169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:16.650125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:16.651589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:16.652636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:16.652636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:16.652636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:16.652636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 376/748] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:16.652636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.669234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.669862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.670178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.670449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.681447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:16.687208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:16.688133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 373/749] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:16.689885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.719401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.773649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953432-f2ea-4e11-8e30-93041671e4d2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.784643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:16.804989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad2b80-daf3-4b30-baa9-797d4fb3eecc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.811015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.811612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.811882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.812143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.812830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:16.813126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.815110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.831531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 377/750] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:16.831531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.847502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:16.848255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:16.848527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:16.848701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:16.849325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:16.850694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:16.865931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 374/751] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:16 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:16.866693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:16.953917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649cd4-d61b-44c4-b510-436f8acf96e4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:16.990030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.012887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.013885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.014465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.014909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.015200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238d01-617e-4dbe-93ec-ef8237284b17 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.015916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.016388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.019886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.035135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 378/752] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.036343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.055179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.055790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.056061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.056324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.056978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.057285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.058672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.070523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 375/753] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.070717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.073768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.160238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef81d-7475-4e59-9fe9-addc635ce2c1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.195958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.196533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.196782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.197051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.197769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=fc10f3b3c22d4195a1090d228e8f4ed6) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.198166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.199753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.209927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 379/754] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/role_assignments?user.id=fc10f3b3c22d4195a1090d228e8f4ed6&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.209927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.211066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea855f6-4157-4e4e-98aa-f286a5350bdc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.275440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.276465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.276941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.277461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.289390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.291257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.306651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.316276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871999a-5915-4558-b118-0a6a1269bf57 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:17.319320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:17.320190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:17.321081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:17.323725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 376/755] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:17.331229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.334621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.360507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.361747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.362071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.362341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.373299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.374827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:17.391707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:17.393500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:17.394794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:17.394794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:17.394794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:17.394794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 380/756] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:17.399024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.517794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b6b2a-9efb-4e25-a899-a4e3892aaf9e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.561486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734d3f-d415-419c-98bc-734a58600685 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.561839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.562571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.562943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.563307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.564870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.565281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.567781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.584031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 381/757] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:17.593973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.610308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.636481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.637703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.638148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.638584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.639426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.639873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.649935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.673490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 377/758] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.678962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.705163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15936-dcd5-4c40-9b8f-6f87dc0cc358 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.744661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.745840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.746283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.746649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.755603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.757457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:17.770622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:17.771786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:17.772968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:17.774675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 382/759] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:17.779942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:17.827350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.893095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:17.906593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdaef6-9b02-4eee-8a71-0182efc88895 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:17.967257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:17.967881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:17.968167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:17.968439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:17.969165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=b88b0656b52c4945896874a40739b5e8) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:17.969476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:17.975600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:17.990040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 378/760] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/role_assignments?user.id=b88b0656b52c4945896874a40739b5e8&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:17.996521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3fa28-12a9-4578-98fc-a9dd29f76b75 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.037208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.037935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.038216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.038533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.039278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.039580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.041156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905b483-c7c1-43a3-967a-37de7d9b528d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.063483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 383/761] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.069161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.083505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a8c0-d8aa-4e7c-9c4d-27bb41315037 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.083811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a8c0-d8aa-4e7c-9c4d-27bb41315037 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.084058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7a8c0-d8aa-4e7c-9c4d-27bb41315037 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.085450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 384/762] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:18.095654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.095961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.096211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.131266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:18.133703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:18.246688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 385/763] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:18.255965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc79d-183d-46a7-8a6a-cd2f55477e27 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.277079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.300477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.319096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.319733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.319999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.320270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.362352 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.362691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.364131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.403145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f27a2-d78e-4cfa-b74f-6f7929843e7f None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:18.406816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.408316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:18.409570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:18.409570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:18.409570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:18.409570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 379/764] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:18.418818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.446130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.446769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.447045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.447313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] PATH_INFO: `/v3/services/network` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.448392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.449832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.459548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.460548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:18.461638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 386/765] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:18.468723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.615090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dbdbe-135e-4e54-9a6f-44cd822a51b2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.645696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22743-2ba2-4ba5-9a8f-684567739eec None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.666725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.679250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.679887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.680113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.680374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.681009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.681305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.682682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.703667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 380/766] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.707223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.707832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.708110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.708449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.709098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.709396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.710829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.712992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.724925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 387/767] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.732897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.781638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:18.898295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae47b04-bcf4-4901-9828-5b0516af3f4e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.901449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276e8d-0c56-4180-9555-4789faf4d7c3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:18.954760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.955385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.955657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.955921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.964877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.966342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.968959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:18.969558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:18.969828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:18.970113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:18.971265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:18.971564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:18.972905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:18.982575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 388/768] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:18.991626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:18.994631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:18.995518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:18.997148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:19.001191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 381/769] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:19.005763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.062971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.137065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.139333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ea65b-b908-435e-8b86-97bedf2961e3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.140828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b0a78-ca46-4120-b558-cbe90303b60f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.186179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.186704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.186979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.187245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.187941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] RBAC: Adding query filter params (interface=public, service_id=06703f8ebfba4a2183dd58bba494c894, region_id=RegionOne) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.188241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.190139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e59cb-c9f2-4f3c-bb9f-acad9706ab58 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.193348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.194262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.195271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.195791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.196965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.197445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.201940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 389/770] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:18 2022] GET /identity/v3/endpoints?service_id=06703f8ebfba4a2183dd58bba494c894&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:19.201940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327326-483f-4180-b01f-18c20f8b63b3 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.201940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327326-483f-4180-b01f-18c20f8b63b3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.201940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327326-483f-4180-b01f-18c20f8b63b3 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.203637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.205262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 390/771] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:19.206479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.206830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.207172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.219995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 382/772] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.222150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.226904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:19.227833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:19.309983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 391/773] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:19.310935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.361545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.368747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475a5a-11fa-4795-9e7d-d4013c57360d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.415192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.416345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.416825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.417429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.418660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.420490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.434157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 383/774] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.434157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.457676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef12e-d590-473f-87db-5c0c8d8e3f31 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.488768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.566677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.567367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.567644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.567917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.578813 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=c221970fdea24fa5997ab29aa35c2f75, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.580828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.582397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408085f7-ef89-450d-9769-665f9155dfd7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.613854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 392/775] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:19 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:19.624343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.625003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.625279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.625542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.626180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.628273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-75bc8f8e-78de-4ff6-8c3a-bc8a367ee628 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:19.638421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:19.640415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:19.641536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 384/776] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:19.646690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.790640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca154c5-3b0f-49f4-b424-c2798bf13c2f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.802317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:19.807018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac622a19-9706-4499-9083-ca3d4cf173e2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.807936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac622a19-9706-4499-9083-ca3d4cf173e2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.807936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac622a19-9706-4499-9083-ca3d4cf173e2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.809127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 385/777] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:19.822280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.822685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.822862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.837123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:19.837740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:19.838034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:19.838300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:19.838932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:19.839226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:19.840595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:19.849191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 393/778] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:19.854745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:19.857754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:19.859860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:19.955626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 386/779] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:19.975621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ce42-96e3-4118-a1b6-da0bd6f31e45 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:19.988437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.018084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.036224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.036835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.037110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.037375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.038759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.039061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.040434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.051204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 394/780] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:20.060149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.104503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.188096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764157-c39e-479d-98f3-23aff00e6ec5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.208117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705842f-d651-46ac-8de1-579bf1e14100 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.250468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.251569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.252067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.252529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.269989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:20.273037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.273879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.274399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.274857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.275743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] RBAC: Adding query filter params (interface=public, service_id=3995cc24f842416d88d78d1e845e51dd, region_id=RegionOne) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.276238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:20.280369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:20.281281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:20.282146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:20.284817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.296575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 387/781] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:20.297116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 395/782] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/endpoints?service_id=3995cc24f842416d88d78d1e845e51dd&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:20.297566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.306814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.429500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.430213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.449391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fc042-b218-4b5d-8991-a83aff6f890e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.455892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764cda4-b260-4bdb-8a1c-b16bcaef7574 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.491739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.492469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.492842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.493205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.494002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:20.494397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.495537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.495934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b428c-d265-4403-b03f-60cb12b94436 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.496459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.496898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.497575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.498848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.500366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af08fbc-5dba-4912-bdbc-971da8829ff4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.514137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 388/784] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:20.514137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415ab5-2741-441e-8b00-eb2c73721d16 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.514137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415ab5-2741-441e-8b00-eb2c73721d16 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.514137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22415ab5-2741-441e-8b00-eb2c73721d16 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.514137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 389/785] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:20.514659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415ab5-2741-441e-8b00-eb2c73721d16 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.514836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 396/785] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:20.530611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.531149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.531852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.571557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:20.572930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:20.702536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22415ab5-2741-441e-8b00-eb2c73721d16 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.716807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 397/786] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 07 18:08:20.749470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.750123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.750399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.750665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.756790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.758553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.764257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:20.766679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:20.788898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:20.789946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:20.790855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:20.790855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:20.790855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:20.790855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 390/787] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:20.796433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:20.882748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:20.917070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc741a-7a33-463d-96ce-87d764aaef66 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.980677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:20.981308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:20.981583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:20.981846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:20.986545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff3ff-5284-47e3-812a-3af915e5dfe5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:20.996787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:21.004231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:21.005232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:21.006496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:21.009333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 398/788] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:21.016814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.063956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.064660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.064937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.065202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.065848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:21.066168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.067549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.092971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 391/789] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:21.098504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.183133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.201002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67d4b5-5fc3-4e91-aff6-376d3030660b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.269057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaa63-4b67-44b9-a218-936e7b34856a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.276526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.277144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.277426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.277694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.278387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:21.278684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.280054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.299130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 399/790] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:21.303820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.318261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.336606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.337244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.337521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.337790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.349781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.351248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:21.373339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:21.374377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:21.375326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:21.378066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 392/791] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:21.380547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.488397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f982-cdc1-4fff-9f15-3f3c3e766941 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.534392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.535028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.535306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.535604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.548370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.550308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:21.567349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:21.568366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:21.569281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:21.569281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:21.569281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:21.569281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 400/792] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:21.574821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.597736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c43d2-e427-435b-a9d8-faef34b39b11 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.620501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.652960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.652960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.652960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.652960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.653374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:21.653374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.653744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.671632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 393/793] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:21.677945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.696444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.759148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8a0a8-1dbc-49a2-b87c-e5ef95f24907 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.802293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.802897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.803591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.803866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.804790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:21.805093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.806988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821d9d-4afe-46ca-88c2-eca23418723e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.816800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af3518-69ee-49a0-be76-580073ac4f35 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.825997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 401/794] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:21.827408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cf76-c578-418c-8b08-2f5d74cc0a8c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.827687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cf76-c578-418c-8b08-2f5d74cc0a8c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.827954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cf76-c578-418c-8b08-2f5d74cc0a8c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.829200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 402/795] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:21.832169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8cf76-c578-418c-8b08-2f5d74cc0a8c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:21.863384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.864014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.864382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.864656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.875818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.877545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f65c1d60-6a16-4a39-be2f-a24fb22784b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:21.897837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:21.899113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:21.900017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:21.900017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:21.900017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:21.901894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 394/796] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:21.903554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.903995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.904406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.924393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:21.925818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:21.941651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.953742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8cf76-c578-418c-8b08-2f5d74cc0a8c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:21.971018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:21.989410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:21.989984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:21.990262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:21.990530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:21.997756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:21.999255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:22.011494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.012652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:22.013607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:22.014319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 395/798] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:22.015670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.017027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 403/798] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.018453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.121395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd8e0-e0b3-4d76-8916-19caff7f8a96 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.140991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c163f5-9bbd-4988-bc95-77535120a62e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.158601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.159196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.159627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.159760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.160417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.160709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.162369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.176879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.177483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.177759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.178057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.178686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.178982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.184843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 404/799] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:22.184989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572e50d-7942-4c01-a69b-9b2cfdec9a7c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.185071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.196385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 396/800] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:22.197466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd600b5-4f5b-4d76-b80e-bfa7d1b34ab7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.197749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd600b5-4f5b-4d76-b80e-bfa7d1b34ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.198050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd600b5-4f5b-4d76-b80e-bfa7d1b34ab7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.202024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 397/801] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:22.202024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd600b5-4f5b-4d76-b80e-bfa7d1b34ab7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.215042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.227532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.301207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfabd-10fa-46e1-b306-768df07cb761 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.310883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd600b5-4f5b-4d76-b80e-bfa7d1b34ab7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.337450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.338103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.338374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.338639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] PATH_INFO: `/v3/services/network` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.339208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.340550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.347404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.348021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.348297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.348568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.349210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.350327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:22.351184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 405/802] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.352025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.366844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.368285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c0daf9d6-b11d-4871-9cee-29c8beb4c412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:22.383840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.384802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 398/803] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.390225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.405132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:22.406331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:22.461317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.465146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf53669-4ab3-4bb3-992e-354840d89527 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.470150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.483493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 399/804] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:22.484354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.516716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.517881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.518432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.518702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.525613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.527077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:22.539592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.540524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:22.541418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 406/805] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.541932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.607889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385cfa5-2b6f-486c-bcb7-33a3f30e065d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.645634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42565a-6fec-424d-8e26-5fa1d3e5a7da None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.647668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.648385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.648658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.648924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.649551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] RBAC: Adding query filter params (name=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.649847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.651232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.656522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 400/806] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:22.657401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.685400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.686126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.686402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.686669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.687312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.687611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.689054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.701016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 407/807] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:22.701819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.722284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.724327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.778815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fd703-953a-4c42-bc4e-7aa70dc4d10a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.805507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b16f0b-bb2c-47c3-8a2c-5380fae251cf None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.816325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.816952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.817228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.817499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.827510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:22.832643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:22.833750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 401/808] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:22.834680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.843605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.844202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.844474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.844737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.845965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.846260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.847660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.864109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 408/809] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:22.864109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:22.931716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2159d-2f3b-4951-b8ed-5db41c1a7658 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.942388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.948449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:22.963849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b21c8-e731-479a-92e7-17a42de56f1b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:22.967110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:22.967711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.967988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.968255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.968869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] RBAC: Adding query filter params (type=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:22.969165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:22.971070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b911-322b-4974-8cf6-5b672a9d5249 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:22.976101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 402/810] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:22.977270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79119-63af-4f95-80b6-ca98b674bbb8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:22.977554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79119-63af-4f95-80b6-ca98b674bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:22.977837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc79119-63af-4f95-80b6-ca98b674bbb8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:22.979073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 403/811] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:22.979764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79119-63af-4f95-80b6-ca98b674bbb8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.002531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.003147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.003419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.003682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.010222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.011662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:23.022941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.023800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:23.024694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 409/812] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.025183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.085813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc79119-63af-4f95-80b6-ca98b674bbb8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.118152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.118678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.118950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.119217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.119856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.120148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.121485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.123000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a216-f1a7-41f7-b723-e2a95af358d1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.129750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 404/813] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.130539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.160690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.161330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.161601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.161864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/fc10f3b3c22d4195a1090d228e8f4ed6/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.169959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.171939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.177465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=fc10f3b3c22d4195a1090d228e8f4ed6, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.178933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e051-fdd1-44a9-9a70-9593260b3b92 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.191389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 410/814] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:23 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/fc10f3b3c22d4195a1090d228e8f4ed6/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:23.192635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.192922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.193193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.225877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:23.227270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:23.244225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cecd-3067-4c41-a8b7-c4efdf411acd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.284214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.284850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.285115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.285381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.286183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.287550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.301416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 411/815] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:23.302518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.337995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 405/816] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:23.337995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.460515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c9a4b-eb28-4b6e-835e-962b52d69076 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.481063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.498633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.513265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39865973-19fb-4fd9-b547-077bcad09fe0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.516519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.517162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.517438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.517704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.518695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.518993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.520432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.535689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 412/817] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.536930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.559012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.559745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.560086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.560365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.571904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.573347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:23.590750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.591761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:23.592643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:23.592643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:23.592643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:23.592643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 406/818] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.592643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.666271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe23867-4a47-4e92-8070-34136236d5b5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.703423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.704048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.704349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.704616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.704990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36119bc-ba71-41e2-ad53-22d1d81967c5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.705187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.706578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:23.715557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:23.716753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:23.717617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 413/819] 10.222.0.30 () {56 vars in 1129 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:23.718470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.745976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.746648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.746921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.747188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/b88b0656b52c4945896874a40739b5e8/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.749139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=b88b0656b52c4945896874a40739b5e8, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.750613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.773930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 407/820] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:23 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/b88b0656b52c4945896874a40739b5e8/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:23.773930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.783035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.784438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:23.866745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5785c8-a50b-49d4-b80c-7223467b4b89 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.906389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b33fe-ca60-420f-9d19-e29d9faaad37 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:23.913393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.914336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.914817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.915223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.916696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.917152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.919206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.940055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 414/821] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.946874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:23.956903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:23.957737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:23.958199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:23.958642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:23.959267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:23.959559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:23.960912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:23.966842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 408/822] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:23.972230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.052063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.056451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9a0b0-3887-4636-a033-1764cdd68df1 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.058878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.099779 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.100411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.100690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.100962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.111155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.112670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.113558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921f61c-fe24-4db5-8377-8dd34930ff9e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:24.124034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:24.125008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:24.125986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 415/823] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:24.133190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.158294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.158935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.159218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.159488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.160114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.160444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.161937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.171732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 409/824] 10.222.0.30 () {56 vars in 1124 bytes} [Sun Aug 7 18:08:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:24.173044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.257527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b874e8-2a37-4d79-8bc9-dad2d950b2c0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.287242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016e6a-1ebe-4a66-a42f-38422d5dd532 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.295365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.296258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.296778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.297258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.298911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:24.299446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.301153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.324037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 416/825] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:24.325051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.332974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.333621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.333921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.334185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.334932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.336289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.341262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.346706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.366543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 410/826] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:24.444625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897157aa-51a3-450c-a7af-53ef6cb5c796 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.489348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.490293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.490720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.491195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.567520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.569188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.583384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:24.673839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 417/827] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:24.679435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.784115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f209b1-4a87-4959-b0b3-2985436552dd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.822597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:24.823249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:24.823524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:24.823790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:24.835242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:24.836683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:24.851236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:24.852159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:24.853048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:24.853048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:24.853048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:24.853048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 411/828] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:24.858968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:24.975168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9b5c0-763e-4e90-8bf7-93bccc15c574 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:24.991370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.014924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.015846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.016337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.016888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.017740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:25.018538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.020086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.032880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 418/829] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:25.038725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.082690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.140465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a603e3-0b20-4c50-8dd3-e37794e1078d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.174989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.175613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.175889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.176150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.182985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.184404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-45e34974-30e5-4523-8a70-417c13abc094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:25.195877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:25.196755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:25.198239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 412/830] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:25.202757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.307128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5f419-5e34-4219-8c94-958056b664da None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.314982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d704-56a1-4e31-9e5b-110fa9e9a0f3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.315261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d704-56a1-4e31-9e5b-110fa9e9a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.315526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082d704-56a1-4e31-9e5b-110fa9e9a0f3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.317067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 413/831] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:25.321918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.322199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.322464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.340378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:25.341542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:25.342586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.343188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.343460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.343724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.344400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:25.344700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.346159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.358666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 419/832] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:25.364891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.396877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.418219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 414/833] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:25.433865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.470833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd21f-a01e-4166-b887-a175cb664bfe None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.478302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.507384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.508350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.508850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.509310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.510305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:25.510806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.512422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.526193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 420/834] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:25.537440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48e1d4-d9f4-4fe6-870d-1836aa3d28db None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.577325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.578060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.578334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.578600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.591675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:25.597422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:25.598445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:25.599272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 415/835] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:25.605088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.712741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.719684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1f78-7f57-4602-a4fd-51c606327662 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.756009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.756623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.756893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.757158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.757810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:25.758131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.759515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8ca7-24a6-47b7-bc64-a92e5127ab04 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.768860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 421/836] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:25.774467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:25.870293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:25.886575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d58f11-6a75-40b8-bd2f-c624d0fd1aea None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:25.910050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020e0b-0ed0-4e00-a847-349d919281a2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.910378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020e0b-0ed0-4e00-a847-349d919281a2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.910607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020e0b-0ed0-4e00-a847-349d919281a2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.912188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 422/837] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:25.917056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.917349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.917623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.921461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:25.922195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:25.922408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:25.922669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:25.934488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:25.935968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:25.937789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:25.939886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:25.954713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:25.955709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:25.956602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:25.956602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:25.956602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:25.956602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 416/838] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:25.962387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.019578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 423/839] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:26.042557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.073642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912105-07e3-47b7-905b-846c8e45c61c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.112623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.113227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.113499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.113762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.114442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:26.114737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.116510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.134818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 417/840] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:26.136143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.139884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.146935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.165200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a34c-054d-47a0-bea7-157afcd9a1a9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.203817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.205800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.206364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.206823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.217749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:26.223075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:26.224112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:26.224943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:26.227570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 424/841] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:26.237978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.269949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d772d3-3976-410e-a948-8de4c80f8c55 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.316443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.317348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.317621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.317883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.328318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.330968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.338490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a559e-36fb-4983-bdc5-e47991ca995d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:26.345008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:26.345942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:26.346900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 418/842] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:26.353016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.388271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.389881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.390388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.390850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.392006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:26.393636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.395302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.406549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 425/843] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:26.412740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.432779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.433356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.480090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46496df1-f5f6-4ef7-b1f9-2282279c7742 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.518461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.519416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.519998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.520544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.521559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:26.522110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.523833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab98ef5-2762-49cf-bf32-2e77df70a0de None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.539504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b44b5-84a3-4d52-b3a7-ab0d5784f484 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.544810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 419/844] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:26.546329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb297ce-8b4c-424d-a723-c7531c7405af None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.546849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb297ce-8b4c-424d-a723-c7531c7405af None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.547327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb297ce-8b4c-424d-a723-c7531c7405af None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.549526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 420/845] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:26.553589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb297ce-8b4c-424d-a723-c7531c7405af None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.578977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.579632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.579904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.580168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.590843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.592374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-664ada9d-de01-4943-9753-2ec828ffccce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:26.607100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:26.608040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:26.608943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:26.608943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:26.608943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:26.610387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 426/846] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:26.612617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.613000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.613456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.630778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:26.631951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:26.662240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb297ce-8b4c-424d-a723-c7531c7405af None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.686832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.688321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.699890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 427/847] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:26.700633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.713151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.713758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.714069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.714334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.788766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.790273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.820781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c712a-5ed6-4f4a-81c6-0dc85a2988de None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:26.861983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:26.862568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:26.862841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:26.863100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:26.863728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:26.864130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:26.865579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:26.883691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 428/848] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:26.884852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.914165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 421/849] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:26.915195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:26.940305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.942643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:26.994663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e36d9-d828-4a44-8278-b73bff3620d8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.023530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6b34-3dc9-4b8d-8f1e-32ced188c9b2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.030096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.030716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.030998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.031265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.031839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.033764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:27.042487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:27.043476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:27.044318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 429/850] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:27.045204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.063053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.063964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.064312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.064584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.071824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.073254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:27.085517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:27.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 422/851] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:27.087441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.152845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9016b-6fc4-4926-976f-d883cc530eac None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.173393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.175286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.192134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.192765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.193041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.193307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.197865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25fcc7-7867-4eea-ae5e-87cc7f5a06e7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.203309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.205019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:27.222140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:27.223125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:27.224071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:27.224071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:27.224071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:27.224071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 430/852] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:27.224308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.238735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.239339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.239664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.239876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.240659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.240769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.242144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.248058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 423/853] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:27.248909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.333918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38639-5493-4468-b200-ac7b1ee4c280 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.357548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5749d-c62e-4ac3-8c4c-34f4ae38feea None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.370575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.371180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.371487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.371723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.372444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.372971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.374220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.396752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 431/854] 10.222.0.30 () {56 vars in 1135 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:27.396752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.400173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.400786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.401060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.401326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.401987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.402285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.403633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.416355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 424/855] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:27.417141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.426846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.431127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.505759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30039b-e0c6-4cd4-aea9-912d45f47bc2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.531220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c1555-0585-41b6-a22a-ab919dcd0fdd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.543753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.544497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.544871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.545259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.546017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.546416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.547931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.562244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 432/856] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:27.562244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.589351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.590144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.590418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.590684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.668513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.670102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04415b-5b4a-4f3d-9c30-ebdddecddf0d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.675311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.679923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.688918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0048-365b-4442-ba8c-12afe4b3cadc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.728353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.728981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.729253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.729519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.736404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.737834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-f0f05492-b528-46b0-b5bc-2ebb1600b15b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:27.751781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:27.752719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:27.753618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 433/857] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:27.754776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361030-b75e-42fd-9538-152fbc0dea11 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.755021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361030-b75e-42fd-9538-152fbc0dea11 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.755285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361030-b75e-42fd-9538-152fbc0dea11 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.757245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 434/858] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:27.758634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361030-b75e-42fd-9538-152fbc0dea11 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.787804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 425/859] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:27.789057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.789336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.789602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.807481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:27.808638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:27.872981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361030-b75e-42fd-9538-152fbc0dea11 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:27.885929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 426/860] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:27.885929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.911589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:27.912052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:27.912328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:27.912587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:27.913273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:27.913571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:27.915162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:27.927606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 435/861] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:27.930993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:27.934465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:27.947284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.005463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2dd03-12b2-4dec-bf66-566f34c67a6a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.041384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.041588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e009a-29a9-46e7-ad51-2383f8dbbc7b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.042038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.042320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.042591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.053083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.054557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:28.069666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:28.070685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:28.071576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:28.071576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:28.071576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:28.071576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 427/862] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:28.071576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.082927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.083555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.083838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.084108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.084702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.086070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:28.096742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:28.097652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:28.098597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 436/863] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:28.099389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.166844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.180793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da48a-6e63-4502-bbdd-8f30ca2b3ef0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.182009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.210129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba2842-c44a-4cf6-91ef-5366de4b4e8c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.218447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.219046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.219328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.219596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.220865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=fc10f3b3c22d4195a1090d228e8f4ed6) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.221168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.222588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.229090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 428/864] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/role_assignments?user.id=fc10f3b3c22d4195a1090d228e8f4ed6&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.229865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.246957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.247950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.248414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.248866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.249728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.250233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.252370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.267145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 437/865] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.273888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.377807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f79e-91ff-4d8a-89cb-3dd981a58348 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.422350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.422810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db414-8400-4079-85b9-56a9bdd16c37 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.423522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.423982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.424443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.425257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.425559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.427845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.433433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 429/866] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.438828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.460120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.461610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.462335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.462585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.463342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.465607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.472835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.474293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:28.488817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:28.489770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:28.490820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:28.491256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 438/867] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:28.499324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.583521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffb0b-846a-4e78-8fce-a2d9cf10f8f6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.625933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.627072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.627542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.627913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.628641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.628641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.629981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.633736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f560ac-89cb-40e7-81d1-42ae81f401d5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.634789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 430/868] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:28.682329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.683007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.683281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.683601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.684251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.684551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.686086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128a82d-7b7e-43ee-aea7-b9ab72f7f3bd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.701158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 439/869] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:28.707669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:28.807821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:28.831134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a2e51-7182-42b0-9b83-ceb94d3ec515 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:28.871203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:28.871975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:28.872371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:28.872742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:28.873561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=b88b0656b52c4945896874a40739b5e8) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:28.874023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:28.877768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad24eb-35a6-4b8c-b6f8-b1bd6b24539a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:28.882823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 431/870] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:28 2022] GET /identity/v3/role_assignments?user.id=b88b0656b52c4945896874a40739b5e8&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:29.577028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315be97-a4be-4ef7-9e76-fb0889537930 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.577564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315be97-a4be-4ef7-9e76-fb0889537930 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.577564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315be97-a4be-4ef7-9e76-fb0889537930 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.579274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 440/871] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:29.584655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b3d-371e-43c7-a8ca-f42afcb1edea None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.585097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b3d-371e-43c7-a8ca-f42afcb1edea None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.585179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5b3d-371e-43c7-a8ca-f42afcb1edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.604136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a2bd5b3d-371e-43c7-a8ca-f42afcb1edea None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:29.605322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2bd5b3d-371e-43c7-a8ca-f42afcb1edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:29.681992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 432/872] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:29.698807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315be97-a4be-4ef7-9e76-fb0889537930 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:29.755882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:29.806033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315be97-a4be-4ef7-9e76-fb0889537930 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:29.842821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:29.843846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:29.844330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:29.844850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:29.845767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:29.847433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df311-9708-4618-a5fb-2a205d362afb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:29.865386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 441/873] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:29 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:30.417157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f4a4d-225e-427e-8a2a-8a0c75696066 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.417432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f4a4d-225e-427e-8a2a-8a0c75696066 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.417704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f4a4d-225e-427e-8a2a-8a0c75696066 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.419184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 433/874] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:30.424981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.425488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.426015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.444176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:30.445631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:30.525035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 442/875] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:30.548635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f4a4d-225e-427e-8a2a-8a0c75696066 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:30.628631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:30.666453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f4a4d-225e-427e-8a2a-8a0c75696066 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.702056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.702905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.703328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.703741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.714881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-201fb9fc-5730-4305-9360-9bc1e3df153c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:30.720341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:30.721426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:30.722496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:30.724711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 434/876] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:30.732919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:30.776026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:30.823861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514ec8-de9c-4120-bda2-635ff25114b0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.824178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514ec8-de9c-4120-bda2-635ff25114b0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.824400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514ec8-de9c-4120-bda2-635ff25114b0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.825841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 435/877] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:30.831440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.831974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.832435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.848732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720539b-fc61-4ff6-a424-06a47571374c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:30.851276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:30.852538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:30.895720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:30.896397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:30.896744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:30.897078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:30.898116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:30.898485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:30.900600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:30.915469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 443/878] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:30.917529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:30.953724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 436/879] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:30.975157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.049516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69172-9c37-47ef-8e57-c61c288baa4f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.051230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.068100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.088635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.089262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.089539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.089802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.101628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.103106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.110936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb3ae4-0b31-47b1-8c08-8abd16986138 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-bbc2944c-6f2a-4e30-a967-fc7c47bb453d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:31.116637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:31.117549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:31.118503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:31.118503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:31.118503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:31.118503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 444/880] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:31.119034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3e11-caff-48ed-bc14-50ee83389d62 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.119223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3e11-caff-48ed-bc14-50ee83389d62 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.119495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3e11-caff-48ed-bc14-50ee83389d62 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.120958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 445/881] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:31.127066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3e11-caff-48ed-bc14-50ee83389d62 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.152214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.152817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.153093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.153362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.154036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.155373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d82942-58cf-4520-b01c-a0092e155940 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.177969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 437/882] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:30 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:31.177969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.177969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.177969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.193407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:31.194819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:31.259694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3e11-caff-48ed-bc14-50ee83389d62 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.302440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 438/883] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:31.311327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.311949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.312280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.312552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.313221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.314132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.315584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.321875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.330555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 446/884] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:31.336136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.349725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.397861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.463240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c72798-1d0e-4cae-9397-57c0af4b7523 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.471013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fc3e-7a73-475e-8c0d-132bc27a9dcd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.509088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.510313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.510628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.510960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.511870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.513284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.516610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.517750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.518513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.518962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:31.523805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:31.524886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:31.525730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 439/885] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:31.529726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.530578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.532286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:31.545318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:31.546923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:31.548426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:31.551862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 447/886] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:31.552695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.624947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.648512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2ac2-4abd-4c16-b713-249c7ed860b0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.660305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e08c55-73f1-41f3-b7dd-19cb643b8a7c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.668251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.690349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.691342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.691844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.692314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.693227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.693826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.695784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.696480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.697080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.697349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.697614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.698381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.698678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.700076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.702932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 440/887] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:31.714899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.724007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 448/888] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:31.724910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:31.826197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b9c2c-f2ce-4e7d-9d25-d9edf9377e42 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.856528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f36e-65ba-402b-b0ae-59ebc2bf1e7a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:31.863195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.864070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.864654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.865150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.866034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:31.866563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:31.868121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf5c-7c66-4a4b-8ca2-9d2754c922c4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:31.873485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 441/889] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:31.897812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:31.900395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c49f8-748d-4177-b6d5-0ee1e3d2b77c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.900722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c49f8-748d-4177-b6d5-0ee1e3d2b77c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.900998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c49f8-748d-4177-b6d5-0ee1e3d2b77c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.905254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 442/890] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:31.909615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.909951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.910185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.914486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:31.915096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:31.915368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:31.915628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:31.936541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:31.938127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:31.998106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.004234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.006887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.038954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 443/891] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:32.055587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.131444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 449/892] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:32.136850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.168082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.177819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89eaaa-b87b-45f7-969a-e12be813bc2d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.216218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.217271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.217779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.218091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.218662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.220370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:32.229941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:32.230962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:32.231785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:32.236619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 444/893] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:32.237655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.261832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e08a-c2c9-45cf-822c-a4a107a3be86 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.285105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.304874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.305600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.305879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.306172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.317084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.318575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:32.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:32.335758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:32.336859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:32.336859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:32.336859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:32.336859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 450/894] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:32.342319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.352234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe94ab-e2f2-409c-b8eb-415d339dc2d1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.400074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.400605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.400877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.401154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.401761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.402094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.403452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.408648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 445/895] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.414070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.453138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.490418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552922a-061f-4aaf-807b-c7744fda28cc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.518268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c6cb3-69dd-4725-b557-0417a8b82a48 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.521344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.538899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.539879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.540369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.540849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.542263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.542769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.544834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.556483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.557178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.557522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.557866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.558663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.559024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.560485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.563073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 451/896] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.568728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.570741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 446/897] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.576198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.687565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5c75-4947-4e50-bc9f-b1a5e49c3e4d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.709800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c3a2-791f-4d09-aa6a-58d448d8cfc9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.730619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.731560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.732522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.732998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.734147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] RBAC: Adding query filter params (interface=public, service_id=b44b8135ab79467abb5f5ce4ec741fff, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.734881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.737256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.746607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.747303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.747642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.747971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.749081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 447/898] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/endpoints?service_id=b44b8135ab79467abb5f5ce4ec741fff&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:32.754629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.757967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.759704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.763234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:32.776938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:32.777839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:32.778757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:32.781993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 452/899] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:32.784526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.798232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:32.902836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3353e0-cd9c-4094-bc9f-da69c6d8223d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.935114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05c6f9-090a-498f-9e81-5ad277081168 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:32.942924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.943564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.943939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.944306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.945108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:32.945526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.947162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:32.965987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 453/900] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:32.968259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:32.988492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:32.989345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:32.989801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:32.990271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:32.991133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:32.992818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fa94-7f1d-4e8a-91dd-5fa20a12cae1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.006182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 448/901] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/services => generated 1268 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:33.039283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:33.087695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba084-4c2b-4fbc-93fc-92f156782b9c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:33.126651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:33.127270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.127545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.127815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.128549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] RBAC: Adding query filter params (role.id=58d06903fa43458da18a7eeb793dc95c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=fc10f3b3c22d4195a1090d228e8f4ed6) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:33.128851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:33.130331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1eb1-57bf-41c5-8648-5fb2987c5716 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.142087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 454/902] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:32 2022] GET /identity/v3/role_assignments?user.id=fc10f3b3c22d4195a1090d228e8f4ed6&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=58d06903fa43458da18a7eeb793dc95c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:33.360750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8b14-ab4c-4095-929a-bdad65679349 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.361129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8b14-ab4c-4095-929a-bdad65679349 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.361307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8b14-ab4c-4095-929a-bdad65679349 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.362863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 449/903] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:33.368036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.368318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.368588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.390715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:33.392296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:33.460100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 455/904] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:33.483188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb8b14-ab4c-4095-929a-bdad65679349 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:33.584605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:33.592368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb8b14-ab4c-4095-929a-bdad65679349 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:33.626774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:33.627317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.627688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.627956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.628569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:33.629926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:33.638767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:33.639717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:33.640605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 450/905] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:33.647044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:33.716642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:33.762854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909874e9-6bcb-4500-87f4-5c4a27d9f785 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:33.798321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:33.799023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.799316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.799587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.800213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:33.800512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:33.802047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92c48-c6ce-4224-958d-48a1211800e2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.807178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 456/906] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:33.812613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:33.924760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f4d56-3b86-40e6-b712-767a81f5c0eb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:33.958866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:33.959474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.959751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.960020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.960645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:33.960944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:33.962535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:33.967836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 451/907] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:33.970823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90402-e83e-4858-a1fc-29f35b681cb0 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.971280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90402-e83e-4858-a1fc-29f35b681cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.971357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa90402-e83e-4858-a1fc-29f35b681cb0 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:33.972821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 457/908] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:33.973926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:33.979619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:33.979901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:33.980177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.001766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:34.003027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:34.006323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.090059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 458/909] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:34.108923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30718-be8a-4a03-9064-124936e41dcc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.114165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.145515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.146064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.146343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.146621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.147292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] RBAC: Adding query filter params (interface=public, service_id=c7c35fcaf7434ae884f5d200913bfeca, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:34.147599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.148933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.154500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 452/910] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:33 2022] GET /identity/v3/endpoints?service_id=c7c35fcaf7434ae884f5d200913bfeca&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:34.159959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:34.166490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.230469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562b951-1b82-4173-9bed-befb8ffca5c6 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.268851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.269681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.270086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.270419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.271183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.272734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224ae60-d5eb-4d0f-aff6-b803317828f5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.280965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:34.294223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36883f87-d6b3-4524-b726-475120835ebd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:34.299390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 459/911] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:34 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:34.349706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:34.350817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:34.351270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:34.351684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:34.352456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:34.354171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2acb-070b-4d3d-b0d8-a15ad221becd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:34.362870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 453/912] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:34 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:35.123076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24669-5595-416c-991d-97e03f3b7c47 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.123584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24669-5595-416c-991d-97e03f3b7c47 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.123584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24669-5595-416c-991d-97e03f3b7c47 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.125067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 460/913] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:35.130135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32d3b-5d60-420a-96af-588d45f32deb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.130541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32d3b-5d60-420a-96af-588d45f32deb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.130683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32d3b-5d60-420a-96af-588d45f32deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.150114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-77f32d3b-5d60-420a-96af-588d45f32deb None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:35.151205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-77f32d3b-5d60-420a-96af-588d45f32deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:35.223124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 454/914] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:35.245173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24669-5595-416c-991d-97e03f3b7c47 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.345671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3fd02-53bc-43e1-b32c-0b7d2bede0de None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.346029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3fd02-53bc-43e1-b32c-0b7d2bede0de None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.346231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3fd02-53bc-43e1-b32c-0b7d2bede0de None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.347665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 455/915] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:35.353939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.353939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.354140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24669-5595-416c-991d-97e03f3b7c47 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.354217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.364068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.377124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:35.378630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:35.392418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.393300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.393575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.393841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.394623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.396741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:35.407888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:35.408854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:35.409675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 461/916] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:35.414743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.470733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 456/917] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:35.492488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.503648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.539717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014f47-1cd0-4cd2-af68-7b55e94ba89e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.575408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.576341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.576835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.577297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.578161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.578655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.580230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.585617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 462/918] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:35.593705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.607836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7154-c2fd-476a-a606-6a77dd9f0ab3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.631837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.656185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.658377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.658999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.659664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.678411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:35.686716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:35.687851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:35.688917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:35.691643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 457/919] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:35.699837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.709912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddfbc2-2891-4d0e-9bb1-a32e6b7be85a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.745310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.746106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.746487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.746819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.747554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.747936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.749360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.755390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 463/920] 10.222.0.30 () {56 vars in 1114 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:35.761670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.765346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.800730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9993ba-6589-4edb-ad91-df0f89733f77 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.839961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.840929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.841486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.842009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.842860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:35.843368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.844970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.858157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 458/921] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:35.859816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:35.872585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:35.876536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a89b-cf5b-4478-b1c9-077968917fa6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:35.915720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:35.916295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:35.916577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:35.916846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:35.917502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:35.919038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:35.950715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 464/922] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:35.978186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d53a7-95d4-46d5-a27c-7b450ec90f04 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.014336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.029509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.030437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.030890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.031303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.044915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.046648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:36.062965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.064231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:36.065335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:36.065335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:36.065335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:36.067248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 459/923] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:36.073130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.189088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1ee2-b936-4655-8b64-2d6275a924cb None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.223923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.224525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.224847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.225118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.225755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.226077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.227428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.239774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 465/924] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:36.245385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.352804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4fff-992c-4909-b07e-e4a06a118905 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.388155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.388775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.389046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.389306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.398224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.399648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a37ac5c8-6354-4f68-b4cb-6c5544e1df84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:36.410857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.411766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:36.412696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 460/925] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:36.417859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.433290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4903f9-ad06-4f34-95e4-533ff236ec4a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.433567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4903f9-ad06-4f34-95e4-533ff236ec4a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.433838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4903f9-ad06-4f34-95e4-533ff236ec4a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.435206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 461/926] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:36.439844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.441006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbe95-cd41-4997-babc-fb49b6cfabf3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.441291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbe95-cd41-4997-babc-fb49b6cfabf3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.441564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfbe95-cd41-4997-babc-fb49b6cfabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.460970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a8bfbe95-cd41-4997-babc-fb49b6cfabf3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:36.462192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a8bfbe95-cd41-4997-babc-fb49b6cfabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:36.493221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.535288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b46e9-982f-49c7-a9a1-81015039fe5f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.535506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 462/927] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:36.536650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f58ab-4841-4d2b-b34d-3f2769744890 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.536944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f58ab-4841-4d2b-b34d-3f2769744890 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.537209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f58ab-4841-4d2b-b34d-3f2769744890 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.538776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 463/928] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:36.544271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.544555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.544823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.562307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:36.564016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:36.580996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.581599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.582019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.582287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.583123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.583422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.584851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.608634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 466/929] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:36.609493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.634704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 464/930] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:36.635811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.700254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.728621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537d3-7784-4d8e-aefc-615118e99494 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.750083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.753786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960757b-c7ad-4805-bfc3-7302d00d78e4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.766757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.767356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.767633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.767904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.768733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.770113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.779569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.780545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.781379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 467/931] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:36.782782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.796352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.796981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.797254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.797556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.807895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.809328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:36.823838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.824772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:36.825797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:36.825797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:36.825797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:36.825797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 465/932] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:36.826577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.903551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2554eeb-188c-44e1-901d-bf461069245b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.935135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbbf4-47b6-4f30-bf31-da496de9dbc8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:36.945461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.946104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.946379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.946639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.947202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.948553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:36.957114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:36.958078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 18:08:36.959165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:36.963001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 468/933] 10.222.0.30 () {56 vars in 1132 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:36.963871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:36.966508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:36.976229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:36.976824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:36.977098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:36.977361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:36.978007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:36.978304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:36.979640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:36.989447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 466/934] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:36.989447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.006569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.075419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85cc0-f346-4e20-9e45-7b637774e31c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.104319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41379-e770-41d1-8b41-76b1f50df683 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.109068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.109667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.110023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.110293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.110924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.111217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.112568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.124900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 469/935] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.126525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.142519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.143380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.143656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.143920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.144548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.144848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.146229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.155987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 467/936] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.157514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.192961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.235170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e98ea-fd41-4a99-bea0-d4a92012bb4c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.246713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.269797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cf48f-2bd4-4966-8647-11d01f7fec92 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.275103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.275782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.276126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.276466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.277166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.277534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.279007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.289556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 470/937] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.289556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.309624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.310277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.310556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.310860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.318078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.319636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:37.330603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:37.331493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 468/938] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:37.337344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.399446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7acc16-c373-4228-a9f6-ecc68a4f2ce0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.424574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.435949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.436828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.437109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.437381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.438091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.438269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2cac9-167f-4997-b655-b4db49e8f5af None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.438430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.439909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.448463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 471/939] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.449379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.476665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.477406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.477781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.478192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.478954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] RBAC: Adding query filter params (interface=public, service_id=d49f5c8224a44bbeb3ccec789f6e4b62, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.479340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.480759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.486848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 469/940] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/endpoints?service_id=d49f5c8224a44bbeb3ccec789f6e4b62&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.487237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.489979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.557058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60984c-9b3a-4e01-9d30-ffda34d14f37 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.592452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae583bc-238a-43b4-abb9-58cb97913003 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.592669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.593095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.593372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.593641 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.594420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:37.594721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.596143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.608019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 472/941] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:37.608019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.634172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.634861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.635209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.635552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.636271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.637613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.669932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 470/942] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:37.669932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:37.676506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.739674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:37.757137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae76b0-bf0d-40d1-ba6e-b0b1285ca9a7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.795653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfeee-f31f-4b51-9e39-2db2bb35c37f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:37.806623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.807351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.808121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.808474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.809461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.811255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1ecfa-9712-4a7b-9c27-ff12ca5880f0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.826177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 473/943] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:37 2022] GET /identity/v3/services => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:37.842098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:37.842098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:37.842098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:37.842485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/fc10f3b3c22d4195a1090d228e8f4ed6/roles/58d06903fa43458da18a7eeb793dc95c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:37.845547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=fc10f3b3c22d4195a1090d228e8f4ed6, role_id=58d06903fa43458da18a7eeb793dc95c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:37.847125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53643ea3-931a-45ca-ba2e-4d549304737d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:37.863424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 471/944] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:37 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/fc10f3b3c22d4195a1090d228e8f4ed6/roles/58d06903fa43458da18a7eeb793dc95c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:38.093101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebea8-bca9-45bb-9b98-9d534207079c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.093524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebea8-bca9-45bb-9b98-9d534207079c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.093651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebea8-bca9-45bb-9b98-9d534207079c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.095381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 474/945] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:38.102046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.102449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.102826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.122363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:38.123553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:38.192901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 472/946] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:38.215771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebea8-bca9-45bb-9b98-9d534207079c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.323427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebea8-bca9-45bb-9b98-9d534207079c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.339176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.361282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.361811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.362111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.362380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.363017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.364442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.367040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING keystone.server.flask.common [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 18:08:38.385107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.sql.core [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:38.385107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 18:08:38.385107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [parameters: {'id': '616d0ed9b91c4d45a228de6cb49aacc8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 18:08:38.385107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80186) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 616d0ed9b91c4d45a228de6cb49aacc8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 616d0ed9b91c4d45a228de6cb49aacc8. Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:38.393510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 18:08:38.394375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application yield resource Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise self.value Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application session.commit() Aug 07 18:08:38.395808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:08:38.396699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:08:38.397583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:38.398383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [parameters: {'id': '616d0ed9b91c4d45a228de6cb49aacc8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.399254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:38.400039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 616d0ed9b91c4d45a228de6cb49aacc8. Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:38.400936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 475/947] 10.222.0.30 () {60 vars in 1140 bytes} [Sun Aug 7 18:08:38 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:38.407831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.457705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:38.518464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeac812-5020-42c0-a2da-0aa325b7739e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.559887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.560537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.560822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.561099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.568384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.569828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9a83f5da-78a7-4232-b230-bcc9e71f5dc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:38.581260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:38.583356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:38.585416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 473/948] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:38.592631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:38.698921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b55b4-42ec-4475-ab3f-1b3d8b3d67d9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:38.734258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:38.734922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:38.735201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:38.735473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:38.736132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:38.736430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:38.738078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e6247-24b9-4c45-aeb8-505729e6c096 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:38.758563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 476/949] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:39.873481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236e676-1aca-41b6-a8e0-68804e8f2ab7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.874229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236e676-1aca-41b6-a8e0-68804e8f2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.874229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236e676-1aca-41b6-a8e0-68804e8f2ab7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.876698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 474/950] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:39.882940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57073-1815-4ba3-8011-87d398297e26 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.883380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.883477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57073-1815-4ba3-8011-87d398297e26 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.883552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.883640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.889005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b57073-1815-4ba3-8011-87d398297e26 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.891635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 477/951] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:39.896862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b083b-6820-4143-a9c5-2b8910e903cc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:39.897217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b083b-6820-4143-a9c5-2b8910e903cc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:39.897494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b083b-6820-4143-a9c5-2b8910e903cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:39.903283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:39.904898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:39.916720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-869b083b-6820-4143-a9c5-2b8910e903cc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:39.918379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-869b083b-6820-4143-a9c5-2b8910e903cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:39.950724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:39.988874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 475/952] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:40.005361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 478/953] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:40.010927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.026356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aa719-096e-427c-b2b7-3363d1be8674 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.026685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aa719-096e-427c-b2b7-3363d1be8674 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.026901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aa719-096e-427c-b2b7-3363d1be8674 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.028242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 479/954] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:40.028938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aa719-096e-427c-b2b7-3363d1be8674 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.053586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.124470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff044-4f9d-41fb-85f6-aabc8e9979a5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.138923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aa719-096e-427c-b2b7-3363d1be8674 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.159898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.160940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.161222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.161647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.162268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.163626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6aa063d7-1ae9-4185-afba-76324bde393e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:40.173046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:40.174085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:40.175319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:40.177991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.178796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.179134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 476/955] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:40.179384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.179796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.180354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.180641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.180810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.180925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.182545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:40.191883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:40.193168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:40.194276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:40.196478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 480/956] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:40.197365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.202267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:40.203451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:40.227199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.274200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 477/957] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:40.275510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.310939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.318358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6062c00-f342-41ca-8c23-e4a8fdbd1ffd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.354368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.354976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.355251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.355522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.356148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.356444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.357858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.367772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 481/958] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.367772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.404325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d400d-be6d-4f8e-a5a1-2aaf6159384b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.440372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.440972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.441250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.441521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.442176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.442484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.443845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.454514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 478/959] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.454514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.465156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.479487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0614b-adf7-42dd-b7ef-40158d3f09e4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.515386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.516540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.516818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.517167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.528308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:40.534149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:40.535180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:40.536211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:40.541008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 482/960] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:40.541723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.553649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.564327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca76bab-0b16-4151-b098-fb0ba515bb72 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.603914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.604519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.604819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.605119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.605836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.606174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.607516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.612237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 479/961] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.613104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.677951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f57ae-927b-4739-a836-122d5a504dc8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.730406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.732115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.732630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.733109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.733980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c908-3c31-4de3-a14e-772c48410010 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.734341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.734902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.737886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.749787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 483/962] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.752262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.768362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.785954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.786660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.786941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.787377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.788366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:40.788817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.790384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.801275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 480/963] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:40.807117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:40.827882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:40.873162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e7b59-c815-4f69-a9eb-9d4b5a84123c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.912356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.912960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.913225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.913491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.914176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:40.915637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b6dd-8735-49ca-9899-7ce10bf69f46 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:40.929570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173e51-5c21-4e74-9d7e-3252976dcdc8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:40.942802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 484/964] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:40.944306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0ff8-cc02-47b0-80c2-e5b22df71ed9 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.944580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0ff8-cc02-47b0-80c2-e5b22df71ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.944845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f0ff8-cc02-47b0-80c2-e5b22df71ed9 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.949979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 485/965] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:40.951862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.952137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.952404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:40.973700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:40.974977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:40.989305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:40.990393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:40.990864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:40.991376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.005360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.007881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:41.032708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:41.033823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:41.035428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:41.035428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:41.035428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:41.038098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 481/966] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:41.041101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.069703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.088136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 486/967] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:41.107447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.135912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.180116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29abc52-d67a-44ee-bfae-797175e7002f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.219260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.219955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.220231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.220495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.221126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:41.221441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.222989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.228895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec732bb-458c-43a9-88b8-019c5f35787a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.236510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 482/968] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:41.243355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.279469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.280734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.282593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.282593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.283228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.284776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.299805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.sql.core [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:41.299805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 18:08:41.299805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [parameters: {'user_id': '5e4f6a3763c94f329532ec2aae38e189', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 18:08:41.299805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80186) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:41.308748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:41.309708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application yield resource Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application next(self.gen) Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise self.value Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application session.commit() Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 18:08:41.310787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.session.flush() Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application compat.raise_( Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 18:08:41.311706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 18:08:41.312636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application conn.query(q) Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application result.read() Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 18:08:41.313581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [parameters: {'user_id': '5e4f6a3763c94f329532ec2aae38e189', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:41.314451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 18:08:41.315266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.316247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 487/969] 10.222.0.30 () {60 vars in 1131 bytes} [Sun Aug 7 18:08:41 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:41.318025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.377427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb023cc-6a15-4d4f-8de4-1f754249492e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.391487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.410721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.420633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.421238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.421514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.421777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.430606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.432115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.443698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a737937-e400-4298-b136-76aff0179ae3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:41.445649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:41.446643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:41.447597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 483/970] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:41.458875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.492736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.493760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.494136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.494473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.503786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.505850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:41.521730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:41.522942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 18:08:41.524175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:41.525980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 488/971] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:41.530141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.577110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6d54-0e84-4ffa-abda-08e80344274c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.612281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.613187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.613700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.614196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.615124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:41.615655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.617317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.640859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 484/972] 10.222.0.30 () {56 vars in 1149 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:41.642685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:41.653417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a470-e19c-48c3-9479-19b628faf50d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.678531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.693689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.697260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.697867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.698183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.698448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.699415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:41.699717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.701309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.741588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 489/973] 10.222.0.30 () {56 vars in 1101 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:41.771917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6455-e3f6-4673-8140-6738f5c1443d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:41.811674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:41.813302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:41.813820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:41.814337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:41.889788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:41.891566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:41.939791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:41.999045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 485/974] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:42.005297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.117365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d530-c627-4f7e-a742-dff8dfe3e36a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.153727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.154376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.154647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.154916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.164824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.166286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:42.181027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:42.182067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:42.183184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:42.183184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:42.183184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:42.183184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 490/975] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:42.189558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.289019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac13b-8ab9-4f5c-83a4-230b12234bf9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.322200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.322794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.323066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.323327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.323948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:42.324244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.325581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:42.337251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 486/976] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:42.342757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.372644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.443570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f3c1-31cc-4d2b-907d-87f5ea6476ca None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.479538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.480300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.480692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.481052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.488412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.489956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:42.500791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:42.501885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:42.503071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:42.504481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 491/977] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:42.510160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.514249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.611025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ca0f-9a82-4c59-8dab-e0ccf9a4c9fb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.644369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.644968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.645241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.645548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.646202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:42.646499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.647898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d785125-b744-46de-bd02-ee33a6105ab2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:42.664639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 487/978] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:42.665996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.692924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7020-f8e3-479f-9af4-a29a6101f70a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.693218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7020-f8e3-479f-9af4-a29a6101f70a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.693495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7020-f8e3-479f-9af4-a29a6101f70a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.695006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 488/979] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:42.699554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.699835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.700104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.719690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:42.720865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:42.764271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.775909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50326996-34be-464c-a29d-4a5a51c396f2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.788231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:42.798010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 489/980] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:42.817044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.817800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.818181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.818523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.819313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] RBAC: Adding query filter params (role.id=58d06903fa43458da18a7eeb793dc95c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=fc10f3b3c22d4195a1090d228e8f4ed6) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:42.819693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.820815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:42.821253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558d804-fe18-4857-87f1-4a98f5f9f4a1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:42.829444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 492/981] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:42 2022] GET /identity/v3/role_assignments?user.id=fc10f3b3c22d4195a1090d228e8f4ed6&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=58d06903fa43458da18a7eeb793dc95c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:42.946649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff1c6-893f-43f6-aa9d-0e6c00ee9de2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:42.990281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:42.991623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:42.991623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:42.991623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:42.992037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:42.994243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb163030-77d5-420b-a2b9-68200eb27323 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.011033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 490/982] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:42 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:43.063853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120df216-d297-4417-8dd5-7dfe31f8c821 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.064426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120df216-d297-4417-8dd5-7dfe31f8c821 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.064426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120df216-d297-4417-8dd5-7dfe31f8c821 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.066004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 493/983] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:43.072555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.072890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.073103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.095199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:43.096479 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:43.157283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.189607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 491/984] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:43.211394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120df216-d297-4417-8dd5-7dfe31f8c821 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.331987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120df216-d297-4417-8dd5-7dfe31f8c821 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.367186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.367808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.368079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.368341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.368909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.370293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:43.379680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:43.380749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:43.381639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:43.383284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 494/985] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:43.387218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.489188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920ef32-f18f-40c0-a7e4-2e1c4de10517 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.524198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.524799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.525073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.525338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.525990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.526346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.527747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.533966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 492/986] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:43.538468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.559062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.642349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5916c-cdb2-4f2b-9fa0-4b11548f3909 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.675939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.676669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.677097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.677465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.678222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.678621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.680081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.690744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 495/987] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:43.691805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.737880 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.795755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05243-640c-4574-9548-54deb4562f21 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.830067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.830663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.830937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.831216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.831888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] RBAC: Adding query filter params (interface=admin, service_id=d49f5c8224a44bbeb3ccec789f6e4b62, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:43.832189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.833591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8aff-2d8d-40cb-b20f-60af57427b05 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.838749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 493/988] 10.222.0.30 () {56 vars in 1249 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/endpoints?service_id=d49f5c8224a44bbeb3ccec789f6e4b62&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:43.844059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:43.930859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:43.950116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599988de-a88e-4d5c-991a-bea70a31e3fd None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:43.985561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:43.986192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:43.986468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:43.986734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:43.987327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:43.988684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24676108-d4fa-42c6-9b63-56281a9cacc4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:43.995165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 496/989] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:43 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:44.953045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b1e6-23ca-4b9d-8c0f-d95d62c9482b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.953595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b1e6-23ca-4b9d-8c0f-d95d62c9482b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.953595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b1e6-23ca-4b9d-8c0f-d95d62c9482b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.955226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 494/990] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:44.960244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7e3-737e-4240-a624-e211191abac1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:44.960701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7e3-737e-4240-a624-e211191abac1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:44.960781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb7e3-737e-4240-a624-e211191abac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:44.978879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-530cb7e3-737e-4240-a624-e211191abac1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:44.980377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-530cb7e3-737e-4240-a624-e211191abac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:45.048825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:45.070641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b1e6-23ca-4b9d-8c0f-d95d62c9482b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.080919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b731c4-10f4-4676-9362-598a5eec9c6d None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.081214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b731c4-10f4-4676-9362-598a5eec9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.081482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b731c4-10f4-4676-9362-598a5eec9c6d None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.082979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 498/992] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:45.087748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.088025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.088293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.107932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:45.109134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:45.195217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 499/993] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:45.197112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b1e6-23ca-4b9d-8c0f-d95d62c9482b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.207132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.217629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.226705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.235373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.235663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.235940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.236205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] PATH_INFO: `/v3/services/image` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.236831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.238368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:45.247132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:45.248144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:45.248984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 495/994] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:45.253948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.327243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7758b8-00e0-4c01-9b2b-1bc302d97b63 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.355435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf669-deac-419f-b27e-77e64794f878 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.361930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.362552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.362828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.363087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.363658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.365004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:45.373737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:45.374935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:45.376327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 500/995] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:45.381048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.395057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.395658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.395934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.396198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.396812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] RBAC: Adding query filter params (name=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.397108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.398623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.403403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 496/996] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:45.409443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.449748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.452452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.485751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effce05-f003-463d-adb8-9b606449f443 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.516754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5076b8-b01c-4d47-b2c5-5a0985fce753 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.521341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.522142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.522558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.522967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.523843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.524292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.525910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.531270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 501/997] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:45.536934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.557033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.557640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.557929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.558211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.558828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] RBAC: Adding query filter params (type=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.559127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.560480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.564911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 497/998] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:45.647665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a52b6-d2c7-4048-8554-6c1046348f0a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.685031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.685936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.686353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.686760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.687654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.688113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.689654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.691383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.702872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.703965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 502/999] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:45.807049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:45.810800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241b1b-2662-4f45-b398-fdc055216652 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.845679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:45.846303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:45.846580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:45.846848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:45.847534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] RBAC: Adding query filter params (interface=public, service_id=c67e8a7f93ea42c988107dceed12d82a, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:45.847838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:45.849177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0461d4b-c2a6-4246-ab12-45075752aeb0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:45.854388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 498/1000] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/endpoints?service_id=c67e8a7f93ea42c988107dceed12d82a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:45.859673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:45.966939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59292-5bd9-48d4-a536-3229738d9615 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:45.999709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:46.000832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.001107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.001370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.001994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:46.003346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb6d91-defc-454c-a3d0-125ce735594e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:46.015721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 503/1001] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:45 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:08:46.026677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ad37-d41e-4691-80a4-170a2d8855bc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.027520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ad37-d41e-4691-80a4-170a2d8855bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.027520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2ad37-d41e-4691-80a4-170a2d8855bc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.028935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 499/1002] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:46.034599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.034935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.035185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.055214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:46.056412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:46.119924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:46.132003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 504/1003] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:46.154452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2ad37-d41e-4691-80a4-170a2d8855bc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:46.282522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2ad37-d41e-4691-80a4-170a2d8855bc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:46.320942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:46.322029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.322528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.322996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.323775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:46.325362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:46.337562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:46.338791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 18:08:46.339940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:46.342388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 500/1004] 10.222.0.30 () {56 vars in 1126 bytes} [Sun Aug 7 18:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:46.348059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:46.460820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93a02-5cd5-4d36-9314-743c6d02bf03 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:46.496538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:46.497144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.497418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.497683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.498343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:46.498638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:46.500006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:46.510410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 505/1005] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:46.511937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:46.543433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:46.618117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfc4d-e4d2-4f01-9fea-1fc0d24c1fa6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:46.652157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:46.652769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.653089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.653555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.653953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:46.654263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:46.655608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193220b4-5772-4808-8a4f-c0624edbda32 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:46.660504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 501/1006] 10.222.0.30 () {56 vars in 1122 bytes} [Sun Aug 7 18:08:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:46.666573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:46.728207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:46.774824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40a8f-0c43-4813-ba87-d662af4b4b35 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:46.808586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:46.809114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:46.809387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:46.809649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:46.810319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:46.811669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fb69f-ad1d-4056-acbd-1f0697134f7b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:46.834375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 506/1007] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:47.599775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74befc-4c00-43f1-a4eb-4e8e5ef3e38d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.600302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74befc-4c00-43f1-a4eb-4e8e5ef3e38d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.600302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74befc-4c00-43f1-a4eb-4e8e5ef3e38d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.601798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 502/1008] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:47.606692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705ce3-5bf1-4535-85a4-5fd3a4cb9ef3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.607074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705ce3-5bf1-4535-85a4-5fd3a4cb9ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.607233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705ce3-5bf1-4535-85a4-5fd3a4cb9ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.625484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-92705ce3-5bf1-4535-85a4-5fd3a4cb9ef3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:47.626740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-92705ce3-5bf1-4535-85a4-5fd3a4cb9ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:47.698811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 507/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:47.721307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74befc-4c00-43f1-a4eb-4e8e5ef3e38d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:47.814647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:47.825490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74befc-4c00-43f1-a4eb-4e8e5ef3e38d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:47.869210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:47.869782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:47.870090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:47.870356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:47.870993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:47.872335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0bab4-18d7-429d-be59-bc4a06dbe7d6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:47.905976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 503/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:47 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:48.054443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386798-779f-46f2-b25d-bfb478a66aaa None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.054727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386798-779f-46f2-b25d-bfb478a66aaa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.054999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386798-779f-46f2-b25d-bfb478a66aaa None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.056469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 508/1011] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:48.061370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.061658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.061946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.080313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:48.081460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:48.155689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 504/1012] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:48.177868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8386798-779f-46f2-b25d-bfb478a66aaa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:48.222866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:48.282252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8386798-779f-46f2-b25d-bfb478a66aaa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:48.315705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:48.316328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.316601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.316863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.317435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:48.318821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:48.327766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:48.329397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 18:08:48.330346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:48.333984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 509/1013] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:48.335474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:48.421255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:48.445458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdc25e-b651-4e2f-82f7-d38acf66a381 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:48.480249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:48.480850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.481126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.481467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.482120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:48.482422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:48.483773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:48.493854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 505/1014] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:48.495059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:48.597484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3234a5-2b2a-48fe-a8a7-bf0301e6875b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:48.604580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:48.632616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:48.633248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.633492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.633735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.634386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:48.634688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:48.636037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c62e60-298f-4e06-b77d-0950d9a6962c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:48.646262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 510/1015] 10.222.0.30 () {56 vars in 1112 bytes} [Sun Aug 7 18:08:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:48.647756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:48.746689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e720-7921-4616-94aa-7ae962801c40 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:48.779591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:48.780188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.780462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.780726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.781435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:48.782807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d83dd-63c5-484b-b6d7-1d7b7306cde8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:48.797321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:48.810003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 506/1016] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:48.857551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c46ac-ed79-4a4a-9cb9-397fb1f174ba None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.857876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c46ac-ed79-4a4a-9cb9-397fb1f174ba None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.858137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c46ac-ed79-4a4a-9cb9-397fb1f174ba None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.860070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 511/1017] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:48.865890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:48.866231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:48.866487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:48.893845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:48.895078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:48.975349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 507/1018] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:48.998296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c46ac-ed79-4a4a-9cb9-397fb1f174ba None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:49.105727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c46ac-ed79-4a4a-9cb9-397fb1f174ba None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:49.139652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:49.140276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.140603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.141157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.143285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:49.145930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6087e-7534-4280-80f7-10df6ed117a3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:49.147689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 512/1019] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:49.154406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:49.255780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c68d55-e4f3-4f44-a708-3d74d5f07a16 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:49.279086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:49.291068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:49.291675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.291949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.292218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.292858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:49.294299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3229e-2e85-46fd-aa15-f07126affb0a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:49.325921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 508/1020] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:08:49 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:08:49.950469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5ce2-d035-42d5-a529-041d48ad731c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.950994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5ce2-d035-42d5-a529-041d48ad731c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.950994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5ce2-d035-42d5-a529-041d48ad731c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.952485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 513/1021] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:49.957331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:49.957722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:49.957887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:49.976246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:49.977402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:50.044268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 509/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:50.067298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5ce2-d035-42d5-a529-041d48ad731c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.108897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.177138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5ce2-d035-42d5-a529-041d48ad731c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.210035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.210651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.210926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.211193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] PATH_INFO: `/v3/services/image` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.211757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.213101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:50.222107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:50.223077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:50.224016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:50.226255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 514/1023] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:50.229144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.327026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e0293-6efb-4006-afa4-c88c2a28f6b0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.334757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.363546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.364137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.364408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.364672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.365282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] RBAC: Adding query filter params (name=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:50.365576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.367122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.372062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 510/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:50.377640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.485501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4406-507c-4a30-80f1-b2d9a299cb89 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.487463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:50.522034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.522643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.522921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.523190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.523813 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] RBAC: Adding query filter params (type=image) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:50.524112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.525471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.535293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 515/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:50.536877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.636474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7b347-4bd1-472f-a074-7a6d5eb2304a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.670203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.670807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.671087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.671354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.672071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] RBAC: Adding query filter params (interface=public, service_id=b7f4e0d8618f47cfb17339cbc486e52a, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:50.672376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.673724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632816a7-bfd7-4b16-85ec-b00a6a08ef6d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.683149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 511/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/endpoints?service_id=b7f4e0d8618f47cfb17339cbc486e52a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:50.684907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:50.785770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbb348-f7c6-4f02-a0a7-3188c4d8da36 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:50.818520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:50.819129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.819396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.819656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.820243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:50.821586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773756a2-d90f-4985-9662-b70cfa14eaf5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:50.833921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 516/1027] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:08:50 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:08:50.974768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccd7-86cd-41ce-ad32-71251d52bc2d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.975308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccd7-86cd-41ce-ad32-71251d52bc2d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.975308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccd7-86cd-41ce-ad32-71251d52bc2d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:50.976613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 512/1028] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:50.981859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:50.982298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:50.982401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.001711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:51.003054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:51.029268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.074716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 517/1029] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:51.098516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cccd7-86cd-41ce-ad32-71251d52bc2d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.134755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.204958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cccd7-86cd-41ce-ad32-71251d52bc2d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.239500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.240121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.240396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.240662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.251149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dec3545a-f317-4303-8e62-b41721793c3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:51.255799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:51.256756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:51.257599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:51.261858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 513/1030] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:51.263213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.365284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e54eb0-238a-4c1f-b899-e6ccf355f7ef None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.369251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1968-ee3c-4e7e-bb5e-3dedd7a9dbc2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.369537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1968-ee3c-4e7e-bb5e-3dedd7a9dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.369805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1968-ee3c-4e7e-bb5e-3dedd7a9dbc2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.371334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 514/1031] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:51.376482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.376763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.377041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.394874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:51.396043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:51.400719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.401550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.402049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.402518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.403373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:51.403812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.405310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.415076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 518/1032] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:51.420879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.446040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.470310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 515/1033] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:51.494085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.523055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.532511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6d27-bab6-4b0b-8875-1e9682b4f580 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.569483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.570527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.570527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.570722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.582013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.583806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:51.598122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:51.599125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:51.600043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:51.600043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:51.600043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:51.600043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 519/1034] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:51.604796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.610110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5a2f8-605a-4d16-90d5-3c875f26a040 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.646496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.647038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.647311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.647575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.648675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.650110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.651823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 516/1035] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:51.657423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.683548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.711255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a17fc-a663-4a59-8c89-b11df57449c9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.749570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.750251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.750530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.750798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.751434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:51.751733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.753083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.754554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.764982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311b210-a2a6-4cda-ab73-d762e54f1bd1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.770470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 520/1036] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:51.771936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:51.805172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.806082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.806554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.806825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.807461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.808871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.832707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 517/1037] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:08:51 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:51.897506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08443dc-2da0-4b64-8324-cafa82c389b2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:51.935327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:51.936019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:51.936299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:51.936576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:51.939453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:51.946971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:51.949028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:51.962528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:51.963710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:51.970496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 521/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:51.973173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.083092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d936a6-1080-4d58-bb8d-30d78e4e6eaa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.116605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.117206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.117483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.117748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.118500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:52.118801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.120210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.137595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 518/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:52.143924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.247891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b91c-15a3-40ce-af19-61cd1b76184d None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.283355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.283963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.284237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.284498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.346823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.355440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.356887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.459003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 522/1040] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:52.464510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.473531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.570955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759622a2-cbc3-4c7f-a17b-3bd6239a3051 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.604073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.604696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.604969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.605235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.616502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.617947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:52.631780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:52.632748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:52.633677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:52.633677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:52.633677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:52.637936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 519/1041] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:52.638797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.732001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.740090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6167-0970-4aa5-ab66-fc465498f4fb None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.774473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.775210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.775579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.775940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.776670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:52.777065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.778547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e586-62a3-4d8d-83b0-2560809cd72c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.789882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 523/1042] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:52.795295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.856238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:52.858099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea140e53-9237-4c95-99ea-d63502cce7ad None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.858435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea140e53-9237-4c95-99ea-d63502cce7ad None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.858773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea140e53-9237-4c95-99ea-d63502cce7ad None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.860500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 524/1043] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:52.865312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.865589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.865858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.884771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:52.885968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:52.907564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9adb9-fc66-4252-b35e-e861e32a3802 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:52.942015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:52.942632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:52.942903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:52.943170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:52.949626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:52.951067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:52.962547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:52.963620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:52.969519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 520/1044] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:52.971943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 525/1045] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:52.975002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:52.989060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.079241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:53.084556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954870ba-cd53-421c-b03f-e213d8f3d20c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.097556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf2d0-7b1b-4872-8bda-9ad65b85f93b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.101945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:53.120284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.120814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.121085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.121347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.122053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:53.122354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.123752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.134160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.134788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.135061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.135326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] PATH_INFO: `/v3/services/image` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.135896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.136630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 521/1046] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:53.138801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.142351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:53.148100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:53.149630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:53.150828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 526/1047] 10.222.0.30 () {56 vars in 1105 bytes} [Sun Aug 7 18:08:52 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:53.154831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.247475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831402-a354-46dd-bb62-48ccf6cde85a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.256846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a17c-a303-46ab-9aa1-250d8c192645 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.285402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.286214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.286635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.287044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.287894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] RBAC: Adding query filter params (role.id=58d06903fa43458da18a7eeb793dc95c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:53.288351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.289411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.290023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.290274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.290414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.290542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.291156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:53.291445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.292765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.297530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 522/1048] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:53 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=58d06903fa43458da18a7eeb793dc95c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:53.298543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 527/1049] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:53.323788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.371758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:53.434394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65130e2-4d9b-4fa8-931e-7cc60203f586 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.471289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.471888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.472160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.472426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.473046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] RBAC: Adding query filter params (type=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:53.473343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.474716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02ab5-e1b3-4ad3-816c-34c97005ef5a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.480724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 523/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:53.486358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:53.502058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:53.611100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dede13-3aea-4c53-b9db-05c59cd62de2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:53.645455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:53.646150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.646530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.646883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.647632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:53.649074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239037c5-dd94-4dd0-8bc4-af445f8b00cb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:53.671190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 528/1051] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:08:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:08:53.975639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831eaa3-9c80-4353-8a41-48e1cb3b3419 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.975933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831eaa3-9c80-4353-8a41-48e1cb3b3419 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.976106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831eaa3-9c80-4353-8a41-48e1cb3b3419 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:53.977569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 524/1052] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:53.982680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:53.982970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:53.983243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:54.001150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:54.002381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:54.064998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:54.077192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 529/1053] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:54.101254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831eaa3-9c80-4353-8a41-48e1cb3b3419 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:54.205359 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831eaa3-9c80-4353-8a41-48e1cb3b3419 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:54.212383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:54.240313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:54.240851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:54.241203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:54.241477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:54.251947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:54.256588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:54.257520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:54.258846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 525/1054] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:54.265947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:54.363962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5a318-30d2-45b1-81d3-7a226dae45c8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:54.400093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:54.400728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:54.401002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:54.401267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:54.401971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:54.402268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:54.403649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:54.417739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 530/1055] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:54.418727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:54.516850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d842-9c08-4042-ab97-764a6cd5f08d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:54.551862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:54.552478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:54.552751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:54.553015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] PATH_INFO: `/v3/users/19e766ff1cad43c4bff341f679fddf4f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:54.566020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] RBAC: Authorizing `identity:get_user(user_id=19e766ff1cad43c4bff341f679fddf4f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:54.567434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:54.568998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 526/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:54 2022] GET /identity/v3/users/19e766ff1cad43c4bff341f679fddf4f => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:54.575235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:54.633644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:54.678933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f82a91-3436-4fff-8f8e-4900bb1f144a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:54.711977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:54.712588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:54.712863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:54.713131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:54.780002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:54.781488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:54.835746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:54.885937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 531/1057] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:08:54.889937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:54.915473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:54.995300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6b3ec-1637-4473-8498-54897e7a7af5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.028918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.029532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.029806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.030145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.031721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.033149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47352e6-de0f-4a34-81e9-271ccbd48869 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.034957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 527/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:54 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:55.040892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.137133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02a3f8-2e1e-47b5-a3f6-e8fb04579dd5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.170536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.171129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.171398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.171721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.172431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=1ad561b5e87144879276c8f3f87cf5a4, user.id=19e766ff1cad43c4bff341f679fddf4f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:55.172728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.174164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dd3f-9363-419f-87fd-5b30996ff05e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.186045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 532/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/role_assignments?user.id=19e766ff1cad43c4bff341f679fddf4f&scope.project.id=1ad561b5e87144879276c8f3f87cf5a4&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:55.304960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ae79-e916-44d3-ad80-572fb4ac4542 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.305465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ae79-e916-44d3-ad80-572fb4ac4542 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.305465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ae79-e916-44d3-ad80-572fb4ac4542 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.306953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 528/1060] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:55.312845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.313332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.313405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.332226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:55.333390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:55.348075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.406614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 533/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:55.426228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ae79-e916-44d3-ad80-572fb4ac4542 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.518947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.530449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ae79-e916-44d3-ad80-572fb4ac4542 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.567498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.568046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.568320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.568585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.578779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:55.583493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:55.584412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:55.585262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:55.589608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 529/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:55.591055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.698528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21634f98-2032-4eac-80b4-dc568eff0be8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.731850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.732451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.732721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.732985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.733641 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:55.733971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.735844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c936-54a9-4f74-b7e7-893080148b6e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.743625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 534/1063] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:55.749376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.764128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b649d-3639-464a-a9e3-cc5564198d3b None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.764412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b649d-3639-464a-a9e3-cc5564198d3b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.764734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b649d-3639-464a-a9e3-cc5564198d3b None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.766144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 535/1064] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:08:55.771872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.772154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.772424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.790663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:55.791832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:55.799975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:55.857316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964165e7-9288-488f-aa35-cd8e7fe516e5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:55.862354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 536/1065] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:55.886819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.899912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b114fd-d243-45bf-959a-683034881614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:55.900538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b114fd-d243-45bf-959a-683034881614 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:55.901198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b114fd-d243-45bf-959a-683034881614 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:55.901469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b114fd-d243-45bf-959a-683034881614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:55.913157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b114fd-d243-45bf-959a-683034881614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:55.914620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b114fd-d243-45bf-959a-683034881614 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-15b114fd-d243-45bf-959a-683034881614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:55.929972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:55.931018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:55.931976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:55.931976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:55.931976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:55.931976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 530/1066] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:55.936622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b114fd-d243-45bf-959a-683034881614 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:55.940352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.000478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab540f-d210-4dac-87c0-18537d6c786d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.038417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.039018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.039291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.039555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.040980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b114fd-d243-45bf-959a-683034881614 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.052960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.076798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.077387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.077661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.078478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.079090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:56.079387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.080731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.093966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 531/1067] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:56.098617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.117386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.119122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.163016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.203802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e4ba2-d7bf-469d-9d47-aa12813648d9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.229798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 537/1068] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:08:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:08:56.230867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.245781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.246446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.246720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.246987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.254933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.256384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:08:56.269968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:56.271046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 532/1069] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:56.277363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.279908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.338473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f59be-cfa0-4084-bb88-0ca5aed86050 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.375868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.376519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.376802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.377071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.383891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5706-839a-429e-8feb-4f630eb6957d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.387995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.389485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:56.405167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:56.406850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:56.413088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:56.413088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:56.413088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:56.413088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 538/1070] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:56.413320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.413394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.422111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.422712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.422985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.423260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.424381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:56.424687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.426466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.444167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 533/1071] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:08:56.449488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.512970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.523494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e24-8d29-434e-88eb-9997b9e23b34 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.556132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4035f-f838-490a-a124-a5ea895bfd87 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.560890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.561511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.561778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.562629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.563793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:56.564253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.566011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.578607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 539/1072] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:56.602898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.603598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.603843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.604107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.616159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.617623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:56.634814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:56.635816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:56.642392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:56.642392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:56.642392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:56.642392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 534/1073] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:56.642639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.754775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d334-e180-4165-8be8-bcf2eb512b9a None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.791288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.791904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.792177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.792444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.793087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:56.793381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.794777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.806742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 540/1074] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:56.813158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:56.852734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:56.932050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a629e-3a80-4441-a1be-2cfa71287eeb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:56.965166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:56.965779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:56.966086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:56.966354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:56.973615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:56.975074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:08:56.986106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:56.987195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:08:56.988182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:56.990054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 535/1075] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:56.993072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.012781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:57.095667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234bef-7336-4c44-a366-fa80f8906f4e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.127340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.127933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.128206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.128472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.129158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:57.129499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:57.130956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4707f-5ddd-4e7c-a655-1a7c30f3e2c6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:57.143403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 541/1076] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:57.149332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.179291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d849-f125-4144-b162-886e9e95fc5d None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.179574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d849-f125-4144-b162-886e9e95fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.179849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d849-f125-4144-b162-886e9e95fc5d None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.181161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 542/1077] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:57.186172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.186452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.186716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.206208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:57.207379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:57.243123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:57.250458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c6dd-e453-43b6-a891-a603dc15d1df None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.274306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 543/1078] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:08:57.283947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.284602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.284879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.285150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/58d06903fa43458da18a7eeb793dc95c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.287284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=c221970fdea24fa5997ab29aa35c2f75, role_id=58d06903fa43458da18a7eeb793dc95c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:57.288692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:57.296603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.299563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:57.301540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 536/1079] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:57 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/c221970fdea24fa5997ab29aa35c2f75/roles/58d06903fa43458da18a7eeb793dc95c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:08:57.401038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd706-6a83-40bc-be36-2fc3c7d57a04 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.435173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.435810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.436082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.436346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.449310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:57.454985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:57.455941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:08:57.456787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 544/1080] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:08:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:57.462346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.560827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd70bf9-03c9-41d4-a08c-8ab007f52ffd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.595199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.595802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.596080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.596348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.596999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:57.597302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:57.598677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:57.607183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 537/1081] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:08:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:57.613538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.675316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:57.712392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11421-4eaa-40ca-a7cc-d1f3c6bc1972 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.745844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.746498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.746774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.747041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] PATH_INFO: `/v3/users/19e766ff1cad43c4bff341f679fddf4f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.748146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] RBAC: Authorizing `identity:get_user(user_id=19e766ff1cad43c4bff341f679fddf4f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:57.750159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:57.751735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 545/1082] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:08:57 2022] GET /identity/v3/users/19e766ff1cad43c4bff341f679fddf4f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:57.757681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:57.775674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:57.855995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312995-680b-44e9-be76-c58abe128f46 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:57.890840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:57.891466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:57.891738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:57.892003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:57.893354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:57.894802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92b160-00aa-4064-bc20-29fef38c02f9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:57.896410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 538/1083] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:08:57 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:57.902686 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:58.007601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe828f0e-b692-41c9-b6ea-1be772cd5c12 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:58.036022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:58.041495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:58.042257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:58.042534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:58.042801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4/users/19e766ff1cad43c4bff341f679fddf4f/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:58.044685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad561b5e87144879276c8f3f87cf5a4, user_id=19e766ff1cad43c4bff341f679fddf4f, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:58.046148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc97deb-73e9-4394-9c16-c28bab88637c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:58.060183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 546/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:08:57 2022] PUT /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4/users/19e766ff1cad43c4bff341f679fddf4f/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:08:59.275098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90fa-bd25-4977-a89f-364b26b74cca None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.275599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90fa-bd25-4977-a89f-364b26b74cca None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.275599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c90fa-bd25-4977-a89f-364b26b74cca None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.276881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 539/1085] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:08:59.282597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.283015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.283122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.300498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:08:59.301642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:08:59.364572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 547/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:08:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:08:59.387136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c90fa-bd25-4977-a89f-364b26b74cca None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:59.469408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:59.487175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c90fa-bd25-4977-a89f-364b26b74cca None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:59.519307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:59.519920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.520192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.520457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.530185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:08:59.535269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:59.536380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:59.537310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 540/1087] 10.222.0.30 () {56 vars in 1120 bytes} [Sun Aug 7 18:08:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:08:59.544073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:59.643330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912618a-f038-45c1-a72d-8519de8a882c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:59.666442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:59.679460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:59.680053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.680322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.680584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.681229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:59.681519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:59.682901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:59.691150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 548/1088] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:08:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:08:59.696737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:59.794269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758848-8938-4f77-bf23-f8d56407d76a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:59.826689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:59.827301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.827630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.828406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.838038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:59.839454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:08:59.841870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:08:59.854849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:08:59.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:08:59.856690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:08:59.856690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:08:59.856690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:08:59.856690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 541/1089] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:08:59.862197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:08:59.962129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763f35-6cee-46fb-9b02-e08e4862d9d7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:08:59.994218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:08:59.994814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:08:59.995083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:08:59.995343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:08:59.995970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:08:59.996262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:08:59.997603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09e7a8-b9b2-4768-b259-1530a2f7322f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.009477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 549/1090] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:00.015120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.049799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae9ca-7fe3-4392-9444-06a04abdc1db None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.050042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae9ca-7fe3-4392-9444-06a04abdc1db None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.050320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae9ca-7fe3-4392-9444-06a04abdc1db None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.051650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 550/1091] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:00.056518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.056794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.057070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.074667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:00.075841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:00.113891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826357-0659-4a5e-a09b-f3d817b87048 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.114956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.141645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 551/1092] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:00.148226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.148867 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.149136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.149396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.156677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.158147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.165102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:09:00.168846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:00.169843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:00.170832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 542/1093] 10.222.0.30 () {56 vars in 1093 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:09:00.175914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.231011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.263415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4d765-5b7b-46e4-a8f9-6d8f0d90a5fc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.274666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c9c43-6e6d-457b-a7e8-d9d5a0af7c3a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.298335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.298966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.299240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.299506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.312394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.312935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.313211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.313476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.314220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:00.314522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.315722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:00.315937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:00.320384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:00.321513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:09:00.322484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 552/1094] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:09:00.327552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.338554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 543/1095] 10.222.0.30 () {56 vars in 1133 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:00.344666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.362206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.430041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff967dd-853e-4c46-a6bc-b179f0fcc809 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.442514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d5727-4494-4bd0-81a1-10c93a4617c8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.456082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.462170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.462766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.463041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.463307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.463951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:00.464244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.465593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.473966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 553/1096] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:00.476633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.477231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.477506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.477773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.479576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.546260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.547677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.571121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.577313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00400324-0e29-480f-894a-fdf396ab2b14 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.610277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.610888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.611161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.611426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] PATH_INFO: `/v3/users/19e766ff1cad43c4bff341f679fddf4f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.612545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] RBAC: Authorizing `identity:get_user(user_id=19e766ff1cad43c4bff341f679fddf4f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.613982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.615555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 554/1097] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/users/19e766ff1cad43c4bff341f679fddf4f => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:00.621234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.644955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 544/1098] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:09:00.650679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.664943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.724542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08525f-af5c-4891-84f1-d68ca8afc140 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.747472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade5c63-7514-4951-a3c5-f638fb0a6f8d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.757330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.757972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.758254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.758521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.781071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.781692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.782002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.782278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.787774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.793319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.794796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:09:00.810009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:00.811121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:09:00.812834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:09:00.812834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:09:00.812834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:00.812834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 545/1099] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:09:00.818034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.828899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.830318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.882068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:00.917965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ce448-7598-4c00-b182-63aa59161e38 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:00.930124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 555/1100] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:00.936099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.950822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:00.951419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:00.951691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:00.951961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:00.952618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:00.952915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:00.954283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:00.965976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 546/1101] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:00.971965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:00.998272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:01.035254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073a67-8d66-433d-a1e9-ef67e9fca754 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.069247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.069882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.070190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.070460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.071156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c31be-3ea4-4490-9611-8239413832a4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.071606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.073028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.074688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 556/1102] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:01.081076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:01.096276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:01.105580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.106232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.106507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.106776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.114180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.115597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:09:01.126515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:01.127504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:01.128422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 547/1103] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:09:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:01.133382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:01.179726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518e66-3da1-4e4f-93f8-c694f2932f60 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.207774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:01.212898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.213489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.213760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.214055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.214765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=1ad561b5e87144879276c8f3f87cf5a4, user.id=19e766ff1cad43c4bff341f679fddf4f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:01.215064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.216498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.222738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 557/1104] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:01 2022] GET /identity/v3/role_assignments?user.id=19e766ff1cad43c4bff341f679fddf4f&scope.project.id=1ad561b5e87144879276c8f3f87cf5a4&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:01.229224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575d1e-b854-4b0f-8bd3-6265c7a6f3f3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.265350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.265980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.266257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.266522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.267219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:01.267520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.269249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041935bf-c527-46d2-92de-e28eca87ed5d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.283208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 548/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:01.289558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:01.393400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519326-733d-46aa-917f-25b05069bc75 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:01.426777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:01.427370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:01.427640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:01.427905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:01.428607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] RBAC: Adding query filter params (role.id=58d06903fa43458da18a7eeb793dc95c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=c221970fdea24fa5997ab29aa35c2f75) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:01.428910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:01.430354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c217e59-cfaa-4cb5-88c0-bbe395f9dedb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:01.436007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 558/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:01 2022] GET /identity/v3/role_assignments?user.id=c221970fdea24fa5997ab29aa35c2f75&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=58d06903fa43458da18a7eeb793dc95c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:03.242640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953d6f-8509-4bd4-8b14-c9398b178cd8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.243140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953d6f-8509-4bd4-8b14-c9398b178cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.243140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a953d6f-8509-4bd4-8b14-c9398b178cd8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.244391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 549/1107] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:03.250098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.250476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.250633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.268742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:03.269891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:03.322255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.334212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 559/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:03.358564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953d6f-8509-4bd4-8b14-c9398b178cd8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.405847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:03.458098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a953d6f-8509-4bd4-8b14-c9398b178cd8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.490086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.490691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.490968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.491235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.492321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:03.493771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877743f-3721-40de-b4cf-4acf4fba8727 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:03.495255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 550/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:09:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:03.501392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:03.597712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28694773-5c35-45f4-aa13-465e432bbc23 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:03.630896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:03.631496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:03.631771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:03.632035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:03.632670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:03.634119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098a0eb-efa4-4dc4-b74f-26fed9098be9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:03.654676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 560/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:09:03 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:05.708429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30753-a21c-4a2a-8cc1-f564b09f8b27 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:05.709071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30753-a21c-4a2a-8cc1-f564b09f8b27 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:05.709071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f30753-a21c-4a2a-8cc1-f564b09f8b27 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:05.710318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 551/1111] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:09:05.715463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:05.715869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:05.716003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:05.733485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:05.734704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:05.776039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:05.800830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 561/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:05.824271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f30753-a21c-4a2a-8cc1-f564b09f8b27 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:05.934849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f30753-a21c-4a2a-8cc1-f564b09f8b27 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:05.948950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:05.968346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:05.968905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:05.969182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:05.969450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] PATH_INFO: `/v3/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:05.970824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] RBAC: Authorizing `identity:get_role(role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:05.972173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:05.973482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 552/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:05 2022] GET /identity/v3/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:05.979519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.076825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f9fc-8558-49bd-ba24-8f315fa88817 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.109758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.110418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.110696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.110965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] PATH_INFO: `/v3/users/1fcbe7647bd14be89a40663d6dea3f67` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.123528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] RBAC: Authorizing `identity:get_user(user_id=1fcbe7647bd14be89a40663d6dea3f67)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.125512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.127177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 562/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:05 2022] GET /identity/v3/users/1fcbe7647bd14be89a40663d6dea3f67 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:06.134142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.230482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dfa1f-eb45-4168-b82a-3a2c661589d0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.265907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.266569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.266842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.267109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.319970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:06.338912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.340356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.439786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 553/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 18:09:06.445780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.478910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:06.544315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697314e9-d444-49c7-99ae-7379ba3e3bfc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.583160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.583802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.584076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.584341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.585494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.586973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450a11-f488-41a5-819c-50028c0fabeb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.588750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 563/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:06.596403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:06.693033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:06.711641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945250ed-6fc6-41c4-b623-10cda933c42e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:06.744991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:06.745583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:06.745858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:06.746156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:06.746859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=1ad561b5e87144879276c8f3f87cf5a4, user.id=1fcbe7647bd14be89a40663d6dea3f67) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:06.747160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:06.748563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363f3c-08bb-4c8b-a6b0-5930a169c97d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:06.753786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 554/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:06 2022] GET /identity/v3/role_assignments?user.id=1fcbe7647bd14be89a40663d6dea3f67&scope.project.id=1ad561b5e87144879276c8f3f87cf5a4&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:08.717130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32619-a047-452e-9b6c-d27af94c77ac None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:08.717676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32619-a047-452e-9b6c-d27af94c77ac None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:08.717676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32619-a047-452e-9b6c-d27af94c77ac None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:08.719522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 564/1118] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:08.724602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:08.725029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:08.725147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:08.743556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:08.744715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:08.809426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 555/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:08.832009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32619-a047-452e-9b6c-d27af94c77ac None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:08.934979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32619-a047-452e-9b6c-d27af94c77ac None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:08.936513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:08.969964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:08.970524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:08.970800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:08.971071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] PATH_INFO: `/v3/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:08.972452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] RBAC: Authorizing `identity:get_role(role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:08.973817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:08.975160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 565/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:08 2022] GET /identity/v3/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:08.981090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.054550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:09.076963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0c825-780f-4fee-99a0-6a988c950051 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.113428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.114076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.114357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.114629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] PATH_INFO: `/v3/users/1fcbe7647bd14be89a40663d6dea3f67` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.115732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] RBAC: Authorizing `identity:get_user(user_id=1fcbe7647bd14be89a40663d6dea3f67)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.117149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:09.118732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 556/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:08 2022] GET /identity/v3/users/1fcbe7647bd14be89a40663d6dea3f67 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:09.124517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.221936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19cfe-4b1f-4154-810d-c6d89a6a041e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.254070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.254685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.254959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.255222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.256302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.257737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c33b-7425-4603-8a5e-8b298348ba3b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:09.259499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 566/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:09 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:09.266318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:09.362765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa60815-fadb-4441-8619-73a3e5d04d74 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:09.395927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:09.396558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:09.396833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:09.397098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4/users/1fcbe7647bd14be89a40663d6dea3f67/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:09.399225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] RBAC: Authorizing `identity:create_grant(project_id=1ad561b5e87144879276c8f3f87cf5a4, user_id=1fcbe7647bd14be89a40663d6dea3f67, role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:09.400628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cb578-1ea7-4e68-9013-3b1c876fedea None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:09.413097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 557/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:09:09 2022] PUT /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4/users/1fcbe7647bd14be89a40663d6dea3f67/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:09:11.374464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0798-0b52-4be0-9d21-cc9f404e9bbf None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:11.374976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0798-0b52-4be0-9d21-cc9f404e9bbf None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:11.375067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0798-0b52-4be0-9d21-cc9f404e9bbf None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:11.376354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 567/1124] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:11.381499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:11.381913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:11.382085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:11.389377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:11.401301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:11.402495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:11.467280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 558/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:11.490590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a0798-0b52-4be0-9d21-cc9f404e9bbf None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:11.529894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:11.587738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a0798-0b52-4be0-9d21-cc9f404e9bbf None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:11.619782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:11.620383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:11.620653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:11.620916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] PATH_INFO: `/v3/roles/e6c72a5032864409ba2aad78a9ceaef2` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:11.622285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] RBAC: Authorizing `identity:get_role(role_id=e6c72a5032864409ba2aad78a9ceaef2)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:11.623637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:11.625456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 568/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:11 2022] GET /identity/v3/roles/e6c72a5032864409ba2aad78a9ceaef2 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:11.631249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:11.727704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862d2b1-5697-45ed-9fb9-e8d62e7437e0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:11.759733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:11.760341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:11.760614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:11.760878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] PATH_INFO: `/v3/users/1fcbe7647bd14be89a40663d6dea3f67` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:11.761990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] RBAC: Authorizing `identity:get_user(user_id=1fcbe7647bd14be89a40663d6dea3f67)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:11.763390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:11.764997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 559/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:11 2022] GET /identity/v3/users/1fcbe7647bd14be89a40663d6dea3f67 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:11.771167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:11.869191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f9ca0-0c0d-41c0-8ad1-441f2c658902 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:11.877249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:11.906574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:11.907182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:11.907459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:11.907725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:11.972394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:11.973838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:12.067234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 569/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:12.073201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:12.076049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:12.169240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a6c1-3837-4809-b903-2ac23261470f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:12.201239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:12.201837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.202182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.202448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] PATH_INFO: `/v3/projects/1ad561b5e87144879276c8f3f87cf5a4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.203531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] RBAC: Authorizing `identity:get_project(project_id=1ad561b5e87144879276c8f3f87cf5a4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:12.204923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce024eee-266e-403f-acd1-c4913bb3711f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:12.206517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 560/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:12 2022] GET /identity/v3/projects/1ad561b5e87144879276c8f3f87cf5a4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:12.212712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:12.221147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:12.309132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5193d0-367b-4366-b6f3-a4b0f7ea2a08 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:12.341268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:12.341845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:12.342145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:12.342411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:12.343701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] RBAC: Adding query filter params (role.id=e6c72a5032864409ba2aad78a9ceaef2, scope.project.id=1ad561b5e87144879276c8f3f87cf5a4, user.id=1fcbe7647bd14be89a40663d6dea3f67) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:12.343998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:12.345412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a2a7-f896-4c26-b8bb-ded95c9e542c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:12.351016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 570/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:12 2022] GET /identity/v3/role_assignments?user.id=1fcbe7647bd14be89a40663d6dea3f67&scope.project.id=1ad561b5e87144879276c8f3f87cf5a4&role.id=e6c72a5032864409ba2aad78a9ceaef2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:14.337784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbf6a6-48df-4057-b41a-64c5cfc760c0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:14.338326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbf6a6-48df-4057-b41a-64c5cfc760c0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:14.338424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbf6a6-48df-4057-b41a-64c5cfc760c0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:14.339666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 561/1131] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:14.345214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:14.345595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:14.345741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:14.363606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:14.364765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:14.425546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:14.430379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 571/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:14.452873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbf6a6-48df-4057-b41a-64c5cfc760c0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:14.522008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:14.554605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbf6a6-48df-4057-b41a-64c5cfc760c0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:14.587536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:14.588194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:14.588419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:14.588684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:14.589768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:14.591201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70bd6-f8be-46c7-9b4c-bc9b83d816ce None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:14.592720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 562/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:09:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:14.598418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:14.691637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d938ff4-d7ef-4155-ab1b-96b0e979e825 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:14.723077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:14.723660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:14.723931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:14.724195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:14.724825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:14.726248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30864b4-8c1d-4724-ba2e-7b4cd1da5e2d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:14.752978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 572/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:09:14 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:16.744947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e608-1445-480b-9ec2-d89f556f3fc5 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:16.745498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e608-1445-480b-9ec2-d89f556f3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:16.745498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e608-1445-480b-9ec2-d89f556f3fc5 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:16.746856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 563/1135] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:16.751873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:16.752302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:16.752410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:16.770626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:16.771783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:16.816361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:16.836059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 573/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:16.860134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e608-1445-480b-9ec2-d89f556f3fc5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:16.960261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e608-1445-480b-9ec2-d89f556f3fc5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:16.993459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:16.994104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:16.994383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:16.994655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:16.995808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:16.997165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b3b74-0dae-47d8-86fc-d1c8deb956b9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:16.998808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 564/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:17.004804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:17.100169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117d68-3914-430c-8587-cae954d21f80 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:17.133677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:17.134302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:17.134579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:17.134844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:17.135463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:17.136998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef37e4e-971d-49fd-823c-0822fcd614b6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:17.158209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 574/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:09:17 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:19.197072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af01da-fc41-4cbf-846c-f42e3475ff77 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.197568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af01da-fc41-4cbf-846c-f42e3475ff77 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.197568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af01da-fc41-4cbf-846c-f42e3475ff77 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.198865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 565/1139] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:19.204444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.204864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.204970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.223080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:19.224230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:19.252228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:19.289651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 575/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:19.312066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af01da-fc41-4cbf-846c-f42e3475ff77 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:19.320911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:19.411760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af01da-fc41-4cbf-846c-f42e3475ff77 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:19.444861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:19.445461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.445732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.446024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.455855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:19.460448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:19.461603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:19.462560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 566/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:19.467750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:19.560406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfffa9-17d3-4696-96a9-c010ac05fcc9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:19.591958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed81da-1079-481c-b646-54affb153921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:19.593050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed81da-1079-481c-b646-54affb153921 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.593321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed81da-1079-481c-b646-54affb153921 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.593585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed81da-1079-481c-b646-54affb153921 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.594269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed81da-1079-481c-b646-54affb153921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:19.594565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed81da-1079-481c-b646-54affb153921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:19.595907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed81da-1079-481c-b646-54affb153921 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:19.603484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 576/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:19.609445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:19.672991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:19.705314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbcce1-6869-4152-ab30-1a5dfaff4db3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:19.738051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:19.738601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.738870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.739133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] PATH_INFO: `/v3/users/a06e407e2ea2482fbf5c40a96f446f8f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.751711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] RBAC: Authorizing `identity:get_user(user_id=a06e407e2ea2482fbf5c40a96f446f8f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:19.753116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:19.754685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 567/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:19 2022] GET /identity/v3/users/a06e407e2ea2482fbf5c40a96f446f8f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:19.760390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed81da-1079-481c-b646-54affb153921 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:19.791503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:19.858682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed81da-1079-481c-b646-54affb153921 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:19.894361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:19.894963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:19.895241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:19.895510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:19.967916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:19.969360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:19.996794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:20.064549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 577/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:20.070416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:20.168079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6796-2f18-49a2-a68a-4f001ac06969 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:20.190859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:20.202571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:20.203190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:20.203468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:20.203739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] PATH_INFO: `/v3/projects/628c5dbf43f74e018dde030286f36f0c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:20.204838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] RBAC: Authorizing `identity:get_project(project_id=628c5dbf43f74e018dde030286f36f0c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:20.206272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e99811-8032-46c5-8a06-9e9eadd83def None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:20.207863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 568/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:20 2022] GET /identity/v3/projects/628c5dbf43f74e018dde030286f36f0c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:20.213784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:20.309761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3000-d69e-4b29-81d5-17df0f5ef522 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:20.337814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:20.343940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:20.344530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:20.344803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:20.345068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:20.345775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=628c5dbf43f74e018dde030286f36f0c, user.id=a06e407e2ea2482fbf5c40a96f446f8f) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:20.346105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:20.347514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2905b7-4311-4aec-9c9a-9b754774f274 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:20.352760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 578/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:20 2022] GET /identity/v3/role_assignments?user.id=a06e407e2ea2482fbf5c40a96f446f8f&scope.project.id=628c5dbf43f74e018dde030286f36f0c&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:22.332491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a866-94d3-47e6-9cb4-860a36d5d4f4 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.332997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a866-94d3-47e6-9cb4-860a36d5d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.332997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a866-94d3-47e6-9cb4-860a36d5d4f4 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.334327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 569/1147] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:22.339581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.339962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.340149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.358071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:22.359217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:22.421653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 579/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:22.443483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a866-94d3-47e6-9cb4-860a36d5d4f4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.542558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a866-94d3-47e6-9cb4-860a36d5d4f4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.575510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.576117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.576397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.577240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.587085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:22.591798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:22.592960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:22.594197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 570/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:22.598661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.694916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66272db-68d4-4c5a-999c-fe074ba4956c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.717869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.728889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.729484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.729763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.730068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.730724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:22.731022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:22.732376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:22.740662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 580/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:22.746493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.800615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:22.845753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e4d5b-4218-4ce6-a3af-0f5b521fa49c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:22.878959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:22.879579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:22.879852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:22.880118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] PATH_INFO: `/v3/users/a06e407e2ea2482fbf5c40a96f446f8f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:22.881217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] RBAC: Authorizing `identity:get_user(user_id=a06e407e2ea2482fbf5c40a96f446f8f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:22.882648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:22.884208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 571/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/users/a06e407e2ea2482fbf5c40a96f446f8f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:22.889893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:22.991578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecacae5-56bd-44dd-870f-cd356e752376 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:23.023683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:23.024292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:23.024563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:23.024825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] PATH_INFO: `/v3/projects/628c5dbf43f74e018dde030286f36f0c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:23.025930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] RBAC: Authorizing `identity:get_project(project_id=628c5dbf43f74e018dde030286f36f0c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:23.027327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7a4e7-77ba-4fdf-9b68-1f4bde324897 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:23.028917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 581/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:22 2022] GET /identity/v3/projects/628c5dbf43f74e018dde030286f36f0c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:09:23.034947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:23.132899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256faa2d-4915-4852-9f5e-3e11173a64a9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:23.151787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:23.166170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:23.166807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:23.167081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:23.167348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] PATH_INFO: `/v3/projects/628c5dbf43f74e018dde030286f36f0c/users/a06e407e2ea2482fbf5c40a96f446f8f/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:23.169199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=628c5dbf43f74e018dde030286f36f0c, user_id=a06e407e2ea2482fbf5c40a96f446f8f, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:23.171248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61f68e-00df-47ca-ae77-33072c201da7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:23.183793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 572/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:09:23 2022] PUT /identity/v3/projects/628c5dbf43f74e018dde030286f36f0c/users/a06e407e2ea2482fbf5c40a96f446f8f/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:09:25.155897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39325-ed87-4e6a-9337-c23cc1b7b654 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.156397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39325-ed87-4e6a-9337-c23cc1b7b654 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.156397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39325-ed87-4e6a-9337-c23cc1b7b654 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.157659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 582/1154] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:25.162838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.163288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.163381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.181638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:25.182847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:25.250889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 573/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:25.274237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa39325-ed87-4e6a-9337-c23cc1b7b654 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.328453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.371840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa39325-ed87-4e6a-9337-c23cc1b7b654 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.403371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.403976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.404247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.405001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.414591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:25.419141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:25.420765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:09:25.421876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 583/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:25.426702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.521556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5fdd-a6cf-4ad8-b678-769a5a7c44a2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.532131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.555840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.556421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.556693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.556955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.557592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:25.557884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.559249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:25.566944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 574/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.572525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.671852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7ddf8-bf64-4739-9043-76a68f494a8b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.685038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.704742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.705360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.705637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.705924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] PATH_INFO: `/v3/users/a06e407e2ea2482fbf5c40a96f446f8f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.707036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] RBAC: Authorizing `identity:get_user(user_id=a06e407e2ea2482fbf5c40a96f446f8f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.708455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:25.710042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 584/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/users/a06e407e2ea2482fbf5c40a96f446f8f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:25.715808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:25.813607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d2eb-f612-4601-bcc7-b4c4c40c5516 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:25.845943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:25.846527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:25.846798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:25.847061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:25.886011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:25.915673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:25.917094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:26.010965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 575/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:26.017321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:26.113728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61571e-9c7f-49ec-b7d0-2f0cc4b1458b None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:26.147012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:26.147622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:26.147899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:26.148167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] PATH_INFO: `/v3/projects/628c5dbf43f74e018dde030286f36f0c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:26.149254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] RBAC: Authorizing `identity:get_project(project_id=628c5dbf43f74e018dde030286f36f0c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:26.150708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457c774-dc70-4599-9481-a893af694e4e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:26.152290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 585/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:26 2022] GET /identity/v3/projects/628c5dbf43f74e018dde030286f36f0c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:26.158297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:26.225446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:26.254723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6dd79-0efd-4439-b264-cc7a68d51bad None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:26.288264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:26.288782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:26.289059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:26.289327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:26.290087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=628c5dbf43f74e018dde030286f36f0c, user.id=a06e407e2ea2482fbf5c40a96f446f8f) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:26.290390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:26.291782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949422-1c36-4a96-9a4e-c5abb58d6893 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:26.297891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 576/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:26 2022] GET /identity/v3/role_assignments?user.id=a06e407e2ea2482fbf5c40a96f446f8f&scope.project.id=628c5dbf43f74e018dde030286f36f0c&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:28.312348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f839-8848-4871-9e02-b0ce531203ed None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.312848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f839-8848-4871-9e02-b0ce531203ed None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.312848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f839-8848-4871-9e02-b0ce531203ed None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.314182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 586/1162] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:28.319450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.319868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.319976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.337194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:28.338382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:28.401821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 577/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:09:28.424178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f839-8848-4871-9e02-b0ce531203ed None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.473878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.522550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f839-8848-4871-9e02-b0ce531203ed None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.555041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.555626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.555900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.556163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.634652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:28.636089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:28.682774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.730714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 587/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:28.737205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.799583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:28.833213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17552-032e-4581-b82f-36e5424fc6b2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:28.866263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:28.866872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:28.867149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:28.867416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:28.873845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:28.875309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c237a0a3-bc86-4bac-9814-ae0ea85c73c3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:28.886601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:28.887808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:28.889540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 578/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:28.894681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:28.993233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88303-8013-42b3-8d45-5c7384a002b9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:29.030752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:29.031346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:29.031621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:29.031883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:29.032511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:29.032806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:29.034176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9d172-ebc0-41ff-8b97-a41eef4c9f72 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:29.041013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 588/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Sun Aug 7 18:09:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:31.003839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb92c-08ed-4055-b8b5-942027a2db3b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:31.004432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb92c-08ed-4055-b8b5-942027a2db3b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:31.004432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb92c-08ed-4055-b8b5-942027a2db3b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:31.005697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 579/1167] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:31.010785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf98cd-cf49-4fa3-b16b-2c5e63a4f090 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:31.011209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf98cd-cf49-4fa3-b16b-2c5e63a4f090 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:31.011332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf98cd-cf49-4fa3-b16b-2c5e63a4f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:31.029018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4cbf98cd-cf49-4fa3-b16b-2c5e63a4f090 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:31.030243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4cbf98cd-cf49-4fa3-b16b-2c5e63a4f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:31.039169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:31.095608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 589/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:31.118338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb92c-08ed-4055-b8b5-942027a2db3b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:31.217072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb92c-08ed-4055-b8b5-942027a2db3b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:31.246652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:31.255857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:31.256458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:31.256734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:31.257003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:31.257648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:31.259036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7907673-73cd-413f-9086-f8e5e0960d62 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:31.281385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 580/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Sun Aug 7 18:09:31 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:33.272168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b936-8ee2-49be-b095-73ffa9ff1f60 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:33.272696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b936-8ee2-49be-b095-73ffa9ff1f60 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:33.272696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b936-8ee2-49be-b095-73ffa9ff1f60 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:33.273983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 590/1170] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:33.279796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:33.280215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:33.280332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:33.297632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:33.298844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:33.367229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 581/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:33.390774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b936-8ee2-49be-b095-73ffa9ff1f60 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:33.487299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b936-8ee2-49be-b095-73ffa9ff1f60 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:33.519665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:33.520268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:33.520544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:33.520810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] PATH_INFO: `/v3/domains/4e7d778db54943e5966bd07c916f8e15` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:33.530780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e7d778db54943e5966bd07c916f8e15)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:33.532166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa83832-e2da-4100-80f6-fa6b6d307388 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:33.533699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 591/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Sun Aug 7 18:09:33 2022] GET /identity/v3/domains/4e7d778db54943e5966bd07c916f8e15 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:33.539322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:33.640858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d2235-ccc5-4ffe-96f9-4a69629e75e7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:33.658565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:33.677170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:33.677757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:33.678061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:33.678325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:33.678937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:33.680337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1229672-6928-4aff-85e7-e15f7e2a757a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:33.705031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 582/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:09:33 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:35.773502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a693-d98c-44c4-9e13-a1e839c189cf None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:35.774078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a693-d98c-44c4-9e13-a1e839c189cf None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:35.774078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a693-d98c-44c4-9e13-a1e839c189cf None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:35.775398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 592/1174] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:35.781209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:35.781651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:35.781766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:35.799217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:35.800378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:35.863655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 583/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:35.889349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a693-d98c-44c4-9e13-a1e839c189cf None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:35.892938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:35.986451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a693-d98c-44c4-9e13-a1e839c189cf None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:36.022529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:36.023168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:36.023440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:36.023755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] PATH_INFO: `/v3/domains/4e7d778db54943e5966bd07c916f8e15` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:36.024875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e7d778db54943e5966bd07c916f8e15)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:36.026319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdb682-8314-42d5-b559-ffbd492f539e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:36.027872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 593/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Sun Aug 7 18:09:35 2022] GET /identity/v3/domains/4e7d778db54943e5966bd07c916f8e15 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:36.033680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:36.125006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:36.128873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c4545-1f19-4a3b-a6ad-e5305f0926fc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:36.163134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:36.163729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:36.164005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:36.164271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:36.164896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:36.166340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13e1d-e34e-42b1-a0d9-5fc2c45663f0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:36.186755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 584/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:09:36 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:09:38.194013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d403-d3e5-4cca-8b92-73b20cad8cea None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.194529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d403-d3e5-4cca-8b92-73b20cad8cea None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.194529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d403-d3e5-4cca-8b92-73b20cad8cea None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.195814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 594/1178] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:38.201008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.201448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.201542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.220239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:38.221502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:38.288247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 585/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:38.311599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025d403-d3e5-4cca-8b92-73b20cad8cea None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:38.382938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:38.415473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025d403-d3e5-4cca-8b92-73b20cad8cea None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:38.448145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:38.448698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.448973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.449239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.458885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:38.463492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:38.464602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:09:38.465838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 595/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:38.471216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:38.551090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:38.566828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e01e-a593-4104-b8c9-511e38a4e426 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:38.599676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:38.600256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.600534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.600797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.601437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:38.601728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:38.603128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:38.610772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 586/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:38.616431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:38.718678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484e3f8-fc4a-4ed9-bcca-348863153e01 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:38.746584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:38.751529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:38.752144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.752418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.752684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] PATH_INFO: `/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.765776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] RBAC: Authorizing `identity:get_user(user_id=06cd8b90dc9740288a3cd7b707ad7f7b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:38.767507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:38.769072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 596/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:38 2022] GET /identity/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:38.774873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:38.869195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facda02-cb39-470d-89e3-d8a867d6d385 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:38.902143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:38.902732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:38.903005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:38.903268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:38.917766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:38.967889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:38.969347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:39.063785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 587/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:39.069620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:39.163652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d085-9fd6-48b1-be65-15a19a1b615e None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:39.195798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:39.196405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:39.196680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:39.196946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] PATH_INFO: `/v3/projects/2981275648f64c808c11526e928049d5` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:39.198064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] RBAC: Authorizing `identity:get_project(project_id=2981275648f64c808c11526e928049d5)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:39.199478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9077-f437-4215-a339-4ce5f66d1d12 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:39.201983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 597/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:39 2022] GET /identity/v3/projects/2981275648f64c808c11526e928049d5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:39.208042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:39.252563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:39.303356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0e21-74de-4be6-b19f-abf3de69b238 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:39.335692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:39.336277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:39.336557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:39.336823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:39.337525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=2981275648f64c808c11526e928049d5, user.id=06cd8b90dc9740288a3cd7b707ad7f7b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:39.337824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:39.340235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21af9-7458-4935-b98c-5856b221ebe8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:39.345388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 588/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:39 2022] GET /identity/v3/role_assignments?user.id=06cd8b90dc9740288a3cd7b707ad7f7b&scope.project.id=2981275648f64c808c11526e928049d5&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:41.311998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060ef3-83d5-4124-a2c5-a1258c6fbef2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:41.312513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060ef3-83d5-4124-a2c5-a1258c6fbef2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:41.312513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060ef3-83d5-4124-a2c5-a1258c6fbef2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:41.313795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 598/1186] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:41.318951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:41.319332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:41.319479 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:41.336750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:41.337924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:41.406744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 589/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:41.429004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060ef3-83d5-4124-a2c5-a1258c6fbef2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:41.486236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:41.527880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060ef3-83d5-4124-a2c5-a1258c6fbef2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:41.560807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:41.561419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:41.561694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:41.561989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:41.571629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:41.576680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:41.577764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:09:41.579033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 599/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:41.583749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:41.623344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:41.680355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4a79-1a05-4334-b384-fc62acb224ae None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:41.712691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:41.713289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:41.713564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:41.713832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:41.714512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:41.714811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:41.716187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:41.723879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 590/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:41.729631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:41.825468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efbfde-10fb-4124-a1c3-817f218274b2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:41.842017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:41.858929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:41.859533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:41.859807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:41.860071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] PATH_INFO: `/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:41.861152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] RBAC: Authorizing `identity:get_user(user_id=06cd8b90dc9740288a3cd7b707ad7f7b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:41.862611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:41.864130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 600/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:41 2022] GET /identity/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:41.869843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:41.966980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fae1d6-56a2-4605-ae58-21bc5ae4e47a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:41.968477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:42.000624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:42.001235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:42.001512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:42.001780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] PATH_INFO: `/v3/projects/2981275648f64c808c11526e928049d5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:42.002904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] RBAC: Authorizing `identity:get_project(project_id=2981275648f64c808c11526e928049d5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:42.004321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc4090-4a51-43bb-8eac-d45f6bc75584 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:42.005939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 591/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:41 2022] GET /identity/v3/projects/2981275648f64c808c11526e928049d5 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:42.011950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:42.107429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239bb7-3586-4beb-b29c-a7b4eb45acfc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:42.138420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:42.139047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:42.139319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:42.139583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] PATH_INFO: `/v3/projects/2981275648f64c808c11526e928049d5/users/06cd8b90dc9740288a3cd7b707ad7f7b/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:42.141411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] RBAC: Authorizing `identity:create_grant(project_id=2981275648f64c808c11526e928049d5, user_id=06cd8b90dc9740288a3cd7b707ad7f7b, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:42.143085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2361bf-aa75-43f1-883d-f4c76cfe8bfe None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:42.155470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 601/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:09:42 2022] PUT /identity/v3/projects/2981275648f64c808c11526e928049d5/users/06cd8b90dc9740288a3cd7b707ad7f7b/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:09:44.113039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b3d5-1075-4730-8e03-f88a19b3f565 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.113610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b3d5-1075-4730-8e03-f88a19b3f565 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.113610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b3d5-1075-4730-8e03-f88a19b3f565 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.114941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 592/1193] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:09:44.119891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.120283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.120430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.138406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:09:44.139501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:09:44.180024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:44.204335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 602/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:09:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:09:44.227006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b3d5-1075-4730-8e03-f88a19b3f565 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:44.325094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b3d5-1075-4730-8e03-f88a19b3f565 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:44.358094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:44.358699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.358970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.359233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.369141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:09:44.374330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:09:44.375587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:09:44.376808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 593/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:09:44.381387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:44.474843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9782-12b5-4560-92b3-44ef8991b872 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:44.506675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:44.507257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.507528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.507793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.508437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:44.508730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:44.510103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:44.518470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 603/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:44.524066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:44.553816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:44.619498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4e3d-6b27-4c93-a7c7-2dbe7636d06d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:44.652386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:44.652991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.653265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.654096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] PATH_INFO: `/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.655184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] RBAC: Authorizing `identity:get_user(user_id=06cd8b90dc9740288a3cd7b707ad7f7b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:44.656587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:44.658137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 594/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Sun Aug 7 18:09:44 2022] GET /identity/v3/users/06cd8b90dc9740288a3cd7b707ad7f7b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:44.664040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:44.702567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:44.760015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633d57-4e19-4a45-922b-05f784503265 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:44.793508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:44.794149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:44.794426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:44.794694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:44.857111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:44.858574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:44.895947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:44.954791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 604/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:09:44.960635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:45.051958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:45.055590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d8dec-f31b-4be6-9a5b-9128925f31d4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:45.088044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:45.088650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:45.088921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:45.089185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] PATH_INFO: `/v3/projects/2981275648f64c808c11526e928049d5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:45.090291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] RBAC: Authorizing `identity:get_project(project_id=2981275648f64c808c11526e928049d5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:45.091715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a364e-c632-4e1c-a928-dfba42abb9ba None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:45.093271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 595/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Sun Aug 7 18:09:44 2022] GET /identity/v3/projects/2981275648f64c808c11526e928049d5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:45.099261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:09:45.195417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22866e6-72b8-472b-95d8-d55587b268d2 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:09:45.227428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:09:45.228012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:09:45.228287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:09:45.228553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:09:45.229257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=2981275648f64c808c11526e928049d5, user.id=06cd8b90dc9740288a3cd7b707ad7f7b) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:09:45.229557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:09:45.230983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40e74-e6d3-4c72-80f6-d945700ea023 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:09:45.236998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 605/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:09:45 2022] GET /identity/v3/role_assignments?user.id=06cd8b90dc9740288a3cd7b707ad7f7b&scope.project.id=2981275648f64c808c11526e928049d5&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:09:55.084093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=17 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:09:55.234601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:39.969077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3802dc-0beb-4252-94a5-43dfa2f4ab4f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:39.969077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3802dc-0beb-4252-94a5-43dfa2f4ab4f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:39.969077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3802dc-0beb-4252-94a5-43dfa2f4ab4f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:39.969077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 596/1201] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:39.974865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:39.975343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:39.977928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.001429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:40.003371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:40.091153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 606/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:40.118549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3802dc-0beb-4252-94a5-43dfa2f4ab4f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:40.254668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3802dc-0beb-4252-94a5-43dfa2f4ab4f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:40.296133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:40.296796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:40.297188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:40.297461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.309453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:40.311660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:40.327281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:40.328622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:40.329863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:40.329863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:40.329863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:40.329863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 597/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:40.335067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:40.469205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4663-5fa3-4905-8d56-294fdc5e05e8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:40.507459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:40.514785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:40.515642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:40.515952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:40.516602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.517250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:40.517576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:40.519007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101ec3-f273-4cdb-851f-b986a1b911da None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:40.533111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 607/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:40.539482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:40.617882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:40.684563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e465a-e613-4f47-9961-2f7a1b6bfb93 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:40.737266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:40.738105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:40.738432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:40.738889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:40.740056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:40.742599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8950f-4813-4f46-9c73-7530a20a7d86 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:40.778041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 598/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Sun Aug 7 18:10:40 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:10:43.036318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad686be-a948-47f5-a421-83ff3f53de4b None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.036947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad686be-a948-47f5-a421-83ff3f53de4b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.036947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad686be-a948-47f5-a421-83ff3f53de4b None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.038359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 608/1206] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:43.043927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.044415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.044508 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.063299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:43.064526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:43.140378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 599/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:43.166891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad686be-a948-47f5-a421-83ff3f53de4b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.293914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad686be-a948-47f5-a421-83ff3f53de4b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.339066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.339708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.339972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.340236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.350973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:43.355709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:43.356678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:43.357536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:43.358934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 609/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:43.364985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.417817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:43.494743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955ecc9-37ff-4014-b5e4-a5be17adb76a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.534437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.535351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.535351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.535583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.536201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:43.536513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:43.537949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:43.546893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 600/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:43.552881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.622203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:43.696105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3703e-f46c-4a08-a98e-36f7307f83f4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.738956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.739614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.739892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.740154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.752845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:43.754712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:43.773309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:43.774353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:43.775289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:43.775289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:43.775289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:43.775289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 610/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:43.782443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:43.925393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:43.929482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf67a28-c822-4f5f-9bd6-4886172633e8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:43.980324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:43.980852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:43.981134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:43.981506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:43.982168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:43.982475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:43.983857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:44.001568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 601/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:44.007694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:44.120334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184cea-5ada-454d-aeec-6a101e23afcb None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:44.122161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:44.163064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:44.163635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:44.163915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:44.164186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:44.172149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:44.173581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:44.185346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:44.188057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:44.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 611/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:44.192948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:44.322750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d89ea6-fe84-451a-a88f-a12e4bfa69c0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:44.375896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:44.376508 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:44.376788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:44.377062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:44.378635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:44.378635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:44.379602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:44.402400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 602/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:44.409608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:44.530520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427274b-4511-4fab-885b-96d929e1e0f3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:44.569798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:44.571187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:44.571187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:44.571480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:44.611422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:44.658272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:44.660036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:44.779555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 612/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:44.786517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:44.814733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:44.912340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b979d24-7189-41f1-89f7-3b56db41a33e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:44.953824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:44.954555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:44.954786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:44.955057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:44.966691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:44.968469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:44.986763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:44.988326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:44.989418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:44.989418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:44.989418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:44.989418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 603/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:44.994470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.063710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.105713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8724d-3b93-4a2b-99da-ab0c025e98b9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.147297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.147965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.148091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.148435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.149030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:45.149335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.150789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.167010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 613/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:45.168554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.254628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.299164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59381ca-1862-4a0c-ba7b-c07638469184 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.337079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.338382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.338738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.339316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.346413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.347835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:45.358972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:45.360132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:45.361290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:45.365948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 604/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:45.366108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.491476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df079a-0a1f-4ade-9c81-ef321b71d140 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.519334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.535380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.536281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.536658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.537179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.538176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:45.538666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.540635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7736ed-836e-40da-a388-b819495b3f74 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.556303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 614/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:45.562195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:45.678096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dba672-0ab7-4c33-a46f-e72a7aa6848c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:45.709211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:45.716451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:45.717070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:45.717343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:45.717616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:45.718357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=cbcc51e7684049648ca969b9f7c97c37) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:45.718671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:45.720179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f3665-7329-4ad3-9636-5ff94c54cfc3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:45.726010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 605/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:45 2022] GET /identity/v3/role_assignments?user.id=cbcc51e7684049648ca969b9f7c97c37&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:48.010286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d70a-d8db-40d1-a715-770edb7009cc None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.010848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d70a-d8db-40d1-a715-770edb7009cc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.010972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d70a-d8db-40d1-a715-770edb7009cc None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.012543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 615/1220] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:48.018241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.018698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.018798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.036924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:48.038138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:48.108800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 606/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:48.130914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d70a-d8db-40d1-a715-770edb7009cc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:48.242676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d70a-d8db-40d1-a715-770edb7009cc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:48.280572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:48.281210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.281486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.281766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.292643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:48.297333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:48.298519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:48.299731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 616/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:48.304623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:48.411762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85cebc-5834-4015-b07c-85bbb10c27c4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:48.435194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:48.448381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:48.449144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.449441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.449713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.450403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:48.450706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:48.452063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:48.460973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 607/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:48.468296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:48.517271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:48.597591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe9d62-4d27-487c-ba09-ecd210ee17e3 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:48.636415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:48.637096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.637465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.637873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.650350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:48.651808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:48.666429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:48.667595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:48.668500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:48.668500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:48.668500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:48.668500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 617/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:48.673507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:48.776750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dc7e-b306-418a-8ed9-6b0e9ff85401 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:48.815305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:48.816065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.816348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.816619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.817352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:48.817656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:48.819523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:48.832376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 608/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:48.838668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:48.938538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:48.947715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795f87d-3cff-4e64-a33b-bfc18847259f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:48.985488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:48.986287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:48.986681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:48.987002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:48.997194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:48.999010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:49.013496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:49.015191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:49.016613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:49.021871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 618/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:49.022009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.079799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:49.136124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c3657-3fff-40eb-9019-3df5a7cd4632 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.174005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.174699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.175011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.175313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.176318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:49.176738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.178287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.197757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 609/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:49.203834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.328061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2d71-ac0d-4d2d-b530-751f605cdb96 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.364536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.365232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.365504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.365795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.378440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.379904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:49.395337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:49.396489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:49.397439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:49.397439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:49.397439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:49.397439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 619/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:49.404036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.521386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a5235-82a1-4af9-9e25-7bf2ebf1948f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.524424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:49.565151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.566023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.566608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.566932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.567825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:49.568288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.571567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.591218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 610/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:49.597982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.611973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:49.714484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3c06e-1b40-4925-99bd-2bb6e7fa60c7 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.754983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.755702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.756005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.756297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.763888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.765343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:49.776977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:49.778077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:49.779113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 620/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:49.784316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:49.901092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abfb31-a024-4e12-8d7f-69f4dc783942 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:49.936381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:49.937016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:49.937275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:49.937530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:49.938254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:49.938557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:49.939964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d15274-3809-4cad-a863-769113341ae6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:49.953382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 611/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:49.959496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:50.029205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:50.070596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91aeb4-b63d-4561-a514-a8054016c958 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:50.107503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:50.108167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:50.108491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:50.108740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/cbcc51e7684049648ca969b9f7c97c37/roles/c2b45a97c3594095a20dc25bd2bc111c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:50.125204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=cbcc51e7684049648ca969b9f7c97c37, role_id=c2b45a97c3594095a20dc25bd2bc111c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:50.126865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7aae4-1efc-41bf-9ebf-fcec49d1f339 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:50.140896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 621/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:10:49 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/cbcc51e7684049648ca969b9f7c97c37/roles/c2b45a97c3594095a20dc25bd2bc111c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:10:52.455349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ba19-02e7-4222-8ad9-fb8d5a7b13da None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:52.455921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ba19-02e7-4222-8ad9-fb8d5a7b13da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:52.455921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ba19-02e7-4222-8ad9-fb8d5a7b13da None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:52.457226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 612/1233] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:52.463044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:52.463485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:52.463580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:52.483122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:52.484419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:52.561377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 622/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:52.596644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ba19-02e7-4222-8ad9-fb8d5a7b13da None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:52.626526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:52.721945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ba19-02e7-4222-8ad9-fb8d5a7b13da None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:52.762735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:52.763473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:52.763752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:52.764028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:52.777523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:52.784698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:52.785820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 18:10:52.786857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:52.787492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 613/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Sun Aug 7 18:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:52.794392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:52.852502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:52.911939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd48c1-0b71-4531-8429-62f65688bf2a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:52.949235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:52.949888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:52.950195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:52.950464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:52.951123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:52.951422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:52.952777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:52.960759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 623/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Sun Aug 7 18:10:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:52.967268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.061007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.079978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858964a-48b6-40ec-95bf-36405bbcf5fb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.119604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.120224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.120497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.120759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.131190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.132784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:53.147991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:53.149128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:53.151278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:53.151278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:53.151278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:53.151278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 614/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:53.156747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.278189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df9e3-d927-409a-8206-6fdd27c4c8b6 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.287704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.316859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.317391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.317672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.317968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.319692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:53.319692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.320234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.334002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 624/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:53.341748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.452798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8e6d-f2a7-41a3-a890-710d859a68c6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.488394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.489009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.489269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.489533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.492214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.498112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.499803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:53.512036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:53.513347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:53.514737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 615/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:53.519466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.645265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8560790-944a-4841-985f-fcf1c03d4f81 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.685583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.686212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.686485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.686755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.687466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:53.687761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.689419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:53.709229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 625/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:53.715588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:53.828427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082cc3c-15f3-4363-964a-cc5b91ad28c6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:53.863465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:53.864069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:53.864346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:53.864614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:53.929307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:53.937161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:53.938761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.045884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 616/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:54.051918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:54.080121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:54.162986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dca33-44cb-4cdb-9e4a-02ac93f546b9 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:54.199229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:54.199775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:54.200048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:54.200319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:54.211561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:54.213671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:54.230118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:54.231371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:54.232441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:54.232441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:54.232441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:54.232441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 626/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:54.237316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:54.339138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:54.345290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95f988-14de-4ec7-aa4a-42dc735ecb81 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:54.385087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:54.385693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:54.385996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:54.386264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:54.386897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:54.387193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:54.388542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.400329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 617/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:54.406160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:54.486072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:54.511607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcacb-3bf1-4b80-8dbd-c5252e907f3f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:54.554312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:54.555091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:54.555189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:54.555521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:54.562940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:54.564383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:54.577086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:54.578389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:54.579426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:54.579958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 627/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:54.586551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:54.699800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c91e-d3ef-4bb6-b46c-98005e065d9a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:54.734610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:54.735482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:54.735853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:54.736211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:54.736938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:54.737345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:54.739389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a40fd-125f-45d7-b486-0fafc1175c2c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.760195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 618/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:54.761635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:54.869466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902660c1-ccfa-4ee7-90ae-a45bdd575e1c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:54.907835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:54.908437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:54.908709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:54.908973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:54.909682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] RBAC: Adding query filter params (role.id=c2b45a97c3594095a20dc25bd2bc111c, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=cbcc51e7684049648ca969b9f7c97c37) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:54.910013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:54.911421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0b617-800e-4518-a01f-54b5ea20cb19 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:54.917643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 628/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:54 2022] GET /identity/v3/role_assignments?user.id=cbcc51e7684049648ca969b9f7c97c37&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=c2b45a97c3594095a20dc25bd2bc111c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:57.158836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274a84-c1af-4345-ba65-2de52b1f8fb8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:57.159364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274a84-c1af-4345-ba65-2de52b1f8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:57.159364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274a84-c1af-4345-ba65-2de52b1f8fb8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:57.160685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 619/1247] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:10:57.166151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:57.166607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:57.166751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:57.173696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:57.187944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:10:57.189129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:10:57.272097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 629/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:10:57.296577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3274a84-c1af-4345-ba65-2de52b1f8fb8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:57.316269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:57.411933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3274a84-c1af-4345-ba65-2de52b1f8fb8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:57.453661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:57.454335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:57.454610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:57.454874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:57.467137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:10:57.473017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:57.474272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:57.475357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 620/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:57.481080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:57.595384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc35fd-2b77-494e-950c-0571ea83dcea None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:57.628854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:57.634368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:57.635335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:57.635773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:57.636279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:57.637023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:57.637324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:57.639512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:57.648650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 630/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:57.655365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:57.746246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:57.774315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd258-df70-4690-9710-36cf5e849d65 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:57.818553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:57.819189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:57.819490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:57.819789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:57.831431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:57.832883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:57.849562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:57.850864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:57.851967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:57.851967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:57.851967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:57.851967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 621/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 18:10:57.858088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:57.974134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309fd19-03f9-43b8-bae4-62475c9acf02 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.011862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.012450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.012815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.013127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.013773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:58.014099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.015566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.029082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 631/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:58.034928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.146440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bcc2c-e7af-4565-9cb9-6069a63d4ada None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.173532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.182153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.182812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.183097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.183333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.191906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.193337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:10:58.206114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:58.207474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:10:58.208808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 622/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:58.213200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.274882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.322904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab8b1-ff1d-4782-8143-9f01da421111 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.358216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.358957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.359278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.359614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.360436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:58.360778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.362397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.381619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 632/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:58.387576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.499256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928d590-fa1c-4efe-ae54-1702ad295d81 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.538119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.538651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.538966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.539235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.612125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.626330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.628163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.741854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 623/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:10:58.748260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:58.853448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66b19-ece6-4a29-ac9e-81c654ac7f87 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:58.868190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:58.902751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:58.903488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:58.903803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:58.904142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:58.914469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:58.915948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:10:58.932171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:58.933475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:10:58.934567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:10:58.934567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:10:58.934567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:58.938245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 633/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:58.939189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:59.035498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:59.049045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44642ae4-a7ca-4b47-a38b-703ea96abe98 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:59.088349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:59.088984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:59.089247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:59.089524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:59.090162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:59.090458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:59.091798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:59.103220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 624/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:10:59.109270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:59.221203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46946ffa-326e-4334-8d98-f4d90e28c275 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:59.259665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:59.260444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:59.260836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:59.261195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:59.268426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:59.269971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:10:59.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:10:59.282919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:10:59.284782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 634/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:10:59.288606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:59.400917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cca39-41c3-4d95-b225-05130f3f6ffd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:59.439460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:59.440193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:59.440473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:59.440742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:59.441453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:59.441815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:59.443491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcdd82-5036-4d3a-8ff2-f94ca3d7a33e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:59.462722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 625/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:10:59.465317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:10:59.495610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:10:59.577985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e659775-ac7c-44d2-83e1-0d885f6400c5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:10:59.620424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:10:59.621160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:10:59.621430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:10:59.621723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:10:59.622579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=cbcc51e7684049648ca969b9f7c97c37) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:10:59.622960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:10:59.624609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046e01-50be-47a0-bc09-63b7a7a1aa11 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:10:59.630980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 635/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:10:59 2022] GET /identity/v3/role_assignments?user.id=cbcc51e7684049648ca969b9f7c97c37&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:01.653129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747a8d-3481-402a-8d7f-03764e4e726d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.653685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747a8d-3481-402a-8d7f-03764e4e726d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.653685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747a8d-3481-402a-8d7f-03764e4e726d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.655002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 626/1261] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:01.660087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.660467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.660617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.679514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:01.680696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:01.743546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 636/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:11:01.765555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747a8d-3481-402a-8d7f-03764e4e726d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:01.777059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:01.864338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747a8d-3481-402a-8d7f-03764e4e726d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:01.898058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:01.898672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:01.898944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:01.899205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:01.909346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:11:01.913878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:01.914995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:01.916056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 627/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:01.920992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:01.938520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:02.017155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578f73-b96f-4996-9f29-64462b8f916f None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.049249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.049832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.050130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.050393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.051034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:02.051326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.052666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.060384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 637/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:02.066332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.130570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:02.162640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e932cb-510f-4b9f-9862-071e6097892b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.194853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.195453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.195724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.195988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.206010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.207418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:11:02.221140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:02.222273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:11:02.223379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:11:02.223379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:02.223379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:02.223379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 628/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:02.227905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.305372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:02.324702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2f6c3-9dbc-4bc3-babe-cd6b40e57df8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.355916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.356496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.356765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.357030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.357682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:02.358008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.359346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.370899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 638/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:02.376407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.471253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e332d9-22a3-40f7-bc58-82238db61f61 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.491001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:02.504627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.505232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.505503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.505768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.513770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.515220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:11:02.526648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:02.527740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:02.529080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 629/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:02.533421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.641138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9201e4-01cc-42da-b2a8-f4dc1b148ef4 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.677306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.677954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.678171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.678437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.679147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:02.679444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.680884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.689271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:02.698389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 639/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:02.704040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.800489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c20b6-c7c9-4d63-864b-8e12a7ae38b4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.832160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.832762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.833033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.833297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.843825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.845233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:11:02.858864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:02.859906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:11:02.861108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:11:02.861108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:02.861108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:02.861108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 630/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:02.865599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:02.960149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442e37-b0b5-469a-a7ef-f89e45efc560 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:02.991523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:02.992108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:02.992382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:02.992647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:02.993796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:02.994113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:02.995453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:03.006038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 640/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:03.011635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:03.043288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:03.110256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa76e4-08c7-4bb4-9d89-2c9018451692 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:03.141484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:03.142109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:03.142383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:03.142647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:03.148884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:03.150833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:11:03.161437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:03.162327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:03.163278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 631/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:03.169173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:03.225878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:03.267209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7894d-aa19-4e2b-a9d3-116331b75439 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:03.299622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:03.300212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:03.300489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:03.300757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:03.301435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:03.301736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:03.303176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34426193-6e76-487d-8b44-76719a918c6a None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:03.314587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 641/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:11:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:03.320332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:03.407665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:03.416557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172856-5e64-4b79-b9dc-6d2006375c29 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:03.448418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:03.449045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:03.449317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:03.449583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] PATH_INFO: `/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/cbcc51e7684049648ca969b9f7c97c37/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:03.451432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=66cd4213348b4082a5c9c4eedfffdff6, user_id=cbcc51e7684049648ca969b9f7c97c37, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:03.452823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82811d83-eb2b-499d-bb0e-6e559a2517e6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:03.465402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 632/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Sun Aug 7 18:11:03 2022] PUT /identity/v3/projects/66cd4213348b4082a5c9c4eedfffdff6/users/cbcc51e7684049648ca969b9f7c97c37/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:11:05.457653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed778-fd64-484f-87f8-a45d3d4cdcb8 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:05.458237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed778-fd64-484f-87f8-a45d3d4cdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:05.458333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ed778-fd64-484f-87f8-a45d3d4cdcb8 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:05.459625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 642/1274] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:05.465319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:05.465687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:05.465861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:05.483906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:05.485065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:05.548861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 633/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:11:05.572526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed778-fd64-484f-87f8-a45d3d4cdcb8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:05.670513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ed778-fd64-484f-87f8-a45d3d4cdcb8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:05.686713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:05.703322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:05.703934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:05.704207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:05.704471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:05.714065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 18:11:05.718594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:05.719672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:05.720720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 643/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Sun Aug 7 18:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:05.725573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:05.803752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:05.823430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0387-43f0-491b-b5b5-786cb32c3a0c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:05.856663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:05.857250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:05.857526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:05.857794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:05.858473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:05.858769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:05.860118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:05.867739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 634/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Sun Aug 7 18:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:11:05.873423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:05.969472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04d90b-a4ae-4085-9e07-44d9289fa95c None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.002086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.002701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.002977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.003237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.013347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.014793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:11:06.029705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:06.030762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:11:06.031673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:11:06.031673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:06.031673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:06.031673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 644/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:06.036448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:06.130918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7754fa-86a3-4c52-bb93-55ede71515da None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.162750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.163329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.163601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.163866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.164481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:06.164856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.166215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.177196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 635/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:06.183480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:06.213957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:06.281895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b155f-5202-4f45-90f8-1223dfc40fd0 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.313255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.313864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.314167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.314435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] PATH_INFO: `/v3/users/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.322052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.323491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 18:11:06.334175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:06.335275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:06.336449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 645/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:06.343079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:06.346746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:06.442045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5698cd-2f97-42a1-9c33-c1e683680250 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.474500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.475103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.475344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.475604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.476305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:06.476599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.478522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.495197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 636/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:06.500864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:06.596788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:06.607049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833348-98f8-49b1-93f7-30a39c6d56da None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.638832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.639423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.639698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.639961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.703824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.705252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.788695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:06.799387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 646/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 18:11:06.805168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:06.864017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:06.901830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fa0b9-b5db-4caa-a00e-cac13a8610e0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:06.934517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:06.935131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:06.935406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:06.935672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:06.945166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:06.946643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 18:11:06.960483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:06.962357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 18:11:06.963618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 18:11:06.963618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 18:11:06.963618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:06.964063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 637/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:06.970153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:07.064817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa988-7cb8-4463-a02c-3ff482bb8fb8 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:07.097480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:07.098091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:07.098363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:07.098627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:07.099257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:07.099552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:07.100886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:07.111572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 647/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Sun Aug 7 18:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:07.117157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:07.213484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9eef1-5f1e-4ea6-8a9d-9f663fbf098d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:07.226206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:07.245680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:07.246309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:07.246587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:07.246855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:07.253146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:07.254584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 18:11:07.266101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:07.267149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 07 18:11:07.268393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 638/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Sun Aug 7 18:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:07.272799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:07.320510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:07.369461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae716d-24aa-4224-b8f8-cad5ea3586c5 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:07.401686 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:07.402296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:07.402572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:07.402836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:07.403513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:07.403811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:07.405213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4720aa-46c9-4f5d-80f7-3138a233060d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:07.416601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 648/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Sun Aug 7 18:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:07.422633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:07.526918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f991-77aa-4572-9692-14029d9e9447 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:07.564126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:07.564906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:07.565217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:07.565544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:07.566538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] RBAC: Adding query filter params (role.id=095db5c1c2a240ddba8b9106a7f48483, scope.project.id=66cd4213348b4082a5c9c4eedfffdff6, user.id=cbcc51e7684049648ca969b9f7c97c37) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:07.566945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:07.568759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284e46-7e85-4e0a-955c-7f84d3034ab9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:07.576975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 639/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Sun Aug 7 18:11:07 2022] GET /identity/v3/role_assignments?user.id=cbcc51e7684049648ca969b9f7c97c37&scope.project.id=66cd4213348b4082a5c9c4eedfffdff6&role.id=095db5c1c2a240ddba8b9106a7f48483 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:09.579644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe9e3-0244-428c-85ff-c11918d79686 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:09.580175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe9e3-0244-428c-85ff-c11918d79686 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:09.580175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fe9e3-0244-428c-85ff-c11918d79686 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:09.581506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 649/1288] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:09.587471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:09.587854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:09.588012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:09.607428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:09.608581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:09.637771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:09.673720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 640/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:11:09.696501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fe9e3-0244-428c-85ff-c11918d79686 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:09.793380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fe9e3-0244-428c-85ff-c11918d79686 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:09.803485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:09.827043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:09.827653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:09.827928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:09.828194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:09.828761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:09.830182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:09.839428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:09.840646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:09.841535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 650/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:11:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:09.848173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:09.944992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944601e-7b6e-4e56-9953-c9cbdec472fa None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:09.978210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:09.978800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:09.979076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:09.979341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:09.979958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:09.980255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:09.981638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3bda9-099e-4e7b-a9b1-5082c8736e61 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:09.986347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 641/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Aug 7 18:11:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:11:09.992033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:10.090226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68b36-7ae0-4263-b822-f6e744a0402f None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:10.121541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:10.122217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:10.122495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:10.122763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] PATH_INFO: `/v3/services` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:10.123379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:10.123675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:10.125020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed767dba-dc08-41dc-a589-788d69259d8d None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:10.129264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 651/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Aug 7 18:11:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:12.093516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e597-d4c2-4dfd-8a1e-6ff9083b684e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:12.094083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e597-d4c2-4dfd-8a1e-6ff9083b684e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:12.094083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e597-d4c2-4dfd-8a1e-6ff9083b684e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:12.095415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 642/1293] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:12.100388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208a35f-63ba-48c2-8f1b-578ceec50667 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:12.100810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208a35f-63ba-48c2-8f1b-578ceec50667 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:12.100919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208a35f-63ba-48c2-8f1b-578ceec50667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:12.118741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4208a35f-63ba-48c2-8f1b-578ceec50667 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:12.119897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4208a35f-63ba-48c2-8f1b-578ceec50667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:12.148524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:12.186714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 652/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:11:12.209229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6e597-d4c2-4dfd-8a1e-6ff9083b684e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:12.239357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:12.307337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6e597-d4c2-4dfd-8a1e-6ff9083b684e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:12.338701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:12.339281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:12.339551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:12.339813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:12.340438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:12.341769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6564f-7557-4262-914b-5667139eab0c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:12.360383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 643/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Sun Aug 7 18:11:12 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:11:14.359707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ce76-5ae0-4c8c-9555-27ce24272eb1 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:14.360246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ce76-5ae0-4c8c-9555-27ce24272eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:14.360246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ce76-5ae0-4c8c-9555-27ce24272eb1 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:14.361617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 653/1296] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:14.366749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:14.367153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:14.367290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:14.385825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:14.387011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:14.456860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 644/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 18:11:14.479313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ce76-5ae0-4c8c-9555-27ce24272eb1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:14.583042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ce76-5ae0-4c8c-9555-27ce24272eb1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:14.624032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:14.624732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:14.625163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:14.625357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:14.626034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:14.627537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:14.636609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:14.637862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:14.638831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 654/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:11:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:14.644727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:14.662834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:14.741450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120dcd-1b64-42e0-9fa0-78a4ef7e6342 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:14.773968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:14.774554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:14.774827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:14.775093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:14.775700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:14.775992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:14.777320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:14.782191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 645/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Aug 7 18:11:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:14.788162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:14.819598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:14.888846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aa145-3abe-48ff-b999-e9e7a339cb59 None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:14.921707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:14.922324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:14.922601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:14.922864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:14.923545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] RBAC: Adding query filter params (interface=public, service_id=5464fccd05c24a7ba82c6f80a9e5ee39, region_id=RegionOne) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:14.923841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:14.925178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c246fc-d08d-4e62-8307-083d975fe4f1 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:14.929995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 655/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Sun Aug 7 18:11:14 2022] GET /identity/v3/endpoints?service_id=5464fccd05c24a7ba82c6f80a9e5ee39&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:14.935506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:15.013345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:15.032140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4b25f-ce33-43c7-a629-584c2b04a70a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:15.064414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:15.064996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:15.065269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:15.065533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:15.066140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:15.067467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964795b4-b3f4-443c-a8e3-5af1f718f018 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:15.074091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 646/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Sun Aug 7 18:11:14 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:11:17.028819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf0b4-0e0b-4510-8520-18af6a6b4a8e None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:17.029375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf0b4-0e0b-4510-8520-18af6a6b4a8e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:17.029375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf0b4-0e0b-4510-8520-18af6a6b4a8e None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:17.030726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 656/1302] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:11:17.035715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89245-f813-486a-9d58-3eda0453863d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:17.036133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89245-f813-486a-9d58-3eda0453863d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:17.036253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab89245-f813-486a-9d58-3eda0453863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:17.054097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aab89245-f813-486a-9d58-3eda0453863d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:11:17.055850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aab89245-f813-486a-9d58-3eda0453863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:11:17.119567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 647/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:11:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 18:11:17.141694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cf0b4-0e0b-4510-8520-18af6a6b4a8e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:17.233084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:17.240135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cf0b4-0e0b-4510-8520-18af6a6b4a8e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:17.272013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:17.272619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:17.272889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:17.273153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:17.274258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:17.275588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 18:11:17.283850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 18:11:17.284998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application with Lock( Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self._enter() Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application return self.creator() Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application created_value = creator( Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: ERROR keystone.server.flask.application Aug 07 18:11:17.285843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 657/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Sun Aug 7 18:11:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 18:11:17.291576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89245-f813-486a-9d58-3eda0453863d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:17.365161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:17.387411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab89245-f813-486a-9d58-3eda0453863d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:17.420971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:17.421516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:17.421791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:17.422093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:17.422711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:11:17.423012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:17.424359 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f1743-ca1a-49cb-ab1a-037af726aef7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:17.429270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 648/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Sun Aug 7 18:11:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:11:17.434807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:11:17.531874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aabe5-e17c-48c1-948b-7072153a49fc None admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:11:17.565131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:11:17.565663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:11:17.565953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:11:17.566220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:11:17.566870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:11:17.568220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84c4bd-0fb4-42d1-bbe3-403f6bf0bf19 None admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:11:17.589031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 658/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:11:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:11:27.426403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=30 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:11:27.584526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:20.017590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f203-36d2-4f76-ae05-dc268d61b176 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.018214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f203-36d2-4f76-ae05-dc268d61b176 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.018214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05f203-36d2-4f76-ae05-dc268d61b176 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.025126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f48c-9474-4cb8-a2ec-44a343d2818d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.025533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f48c-9474-4cb8-a2ec-44a343d2818d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.025742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f48c-9474-4cb8-a2ec-44a343d2818d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.030455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 649/1307] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:20.115351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ad20f48c-9474-4cb8-a2ec-44a343d2818d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:20.116909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ad20f48c-9474-4cb8-a2ec-44a343d2818d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.262757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 659/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:20.314063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.314333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.314605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.316331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 650/1309] 10.222.0.30 () {54 vars in 965 bytes} [Sun Aug 7 18:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:20.322805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020108-afe6-4272-b9a3-f924efa26529 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.323094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020108-afe6-4272-b9a3-f924efa26529 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.323491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9020108-afe6-4272-b9a3-f924efa26529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.468579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d9020108-afe6-4272-b9a3-f924efa26529 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:20.470259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d9020108-afe6-4272-b9a3-f924efa26529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.493213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:20.556005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 660/1310] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Aug 7 18:12:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:12:20.564826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:20.566618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.699748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ba85-1237-4d16-9a86-e9cd1c842788 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:20.796341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:20.798230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:20.798879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:20.799355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:20.801962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:20.876029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:20.944964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:20.946651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f6a1-8ced-466e-aec8-d86796b8c6b8 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:20.971022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 651/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:23.333378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:23.333922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:23.334042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:23.335619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 661/1312] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:23.341335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316d88-9e30-49ad-b0b2-f8365904a809 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:23.341929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316d88-9e30-49ad-b0b2-f8365904a809 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:23.341929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d316d88-9e30-49ad-b0b2-f8365904a809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:23.432016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0d316d88-9e30-49ad-b0b2-f8365904a809 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:23.433252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0d316d88-9e30-49ad-b0b2-f8365904a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:23.533840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 652/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:23.572001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:23.573527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:23.683751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c54e2-d15d-4dde-bfec-76c70cb1afad None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:23.755966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:23.759255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:23.759896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:23.760131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:23.760578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:23.762190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:23.868471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:23.869886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85622564-a168-4ede-95be-572520d88c97 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:23.888763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 662/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:26.182373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:26.183241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:26.183241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:26.184276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 653/1315] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:26.189390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d629-f1c0-4636-b268-2d4cb23087f9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:26.189816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d629-f1c0-4636-b268-2d4cb23087f9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:26.189946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0d629-f1c0-4636-b268-2d4cb23087f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:26.255676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b7f0d629-f1c0-4636-b268-2d4cb23087f9 None None] MFA Rules not processed for user `c57f9edf97cc4625b9968af12791928b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:26.256864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b7f0d629-f1c0-4636-b268-2d4cb23087f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:26.307058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:26.350950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 663/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:12:26.392392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:26.393960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:26.403930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:26.495750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b7950-c490-4e68-acff-30066ae4bc42 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:26.571462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:26.572059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:26.572332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:26.572598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:26.574178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:26.633336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:26.680403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:26.681816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bc016-4d2d-4da0-b489-6371ee91e72a service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:26.700144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 654/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:29.246956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:29.247489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:29.247489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:29.248743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 664/1318] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:29.254690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7162-bb51-4777-87d1-4092de4e5bf3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:29.255100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7162-bb51-4777-87d1-4092de4e5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:29.255235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c7162-bb51-4777-87d1-4092de4e5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:29.327501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-255c7162-bb51-4777-87d1-4092de4e5bf3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:29.328709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-255c7162-bb51-4777-87d1-4092de4e5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:29.424053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 655/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:29.462843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:29.464366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:29.567640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e7ba1-b74e-4ae6-923d-36ebd3313f87 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:29.642327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:29.642927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:29.643220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:29.643467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:29.645685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:29.652453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:29.750987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:29.752417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e26b89-1d4b-47c5-a4e9-8f6b88a68689 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:29.771508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 665/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:32.459252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334155c-db7c-4b96-93cd-43851fd5b5e0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:32.459820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334155c-db7c-4b96-93cd-43851fd5b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:32.459820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334155c-db7c-4b96-93cd-43851fd5b5e0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:32.461267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 656/1321] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:32.466214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235c2e-8d60-4c22-b38b-59863bbf768c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:32.466601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235c2e-8d60-4c22-b38b-59863bbf768c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:32.466755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235c2e-8d60-4c22-b38b-59863bbf768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:32.538574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8d235c2e-8d60-4c22-b38b-59863bbf768c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:32.539782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8d235c2e-8d60-4c22-b38b-59863bbf768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:32.612606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:32.655689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 666/1322] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:32.707647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:32.707930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:32.708204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:32.709634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 657/1323] 10.222.0.30 () {54 vars in 965 bytes} [Sun Aug 7 18:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:32.716165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5311-a91b-4179-8b76-9d6e8d1e3783 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:32.716455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5311-a91b-4179-8b76-9d6e8d1e3783 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:32.716728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd5311-a91b-4179-8b76-9d6e8d1e3783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:32.792417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-32bd5311-a91b-4179-8b76-9d6e8d1e3783 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:32.793593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-32bd5311-a91b-4179-8b76-9d6e8d1e3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:32.869610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 667/1324] 10.222.0.30 () {58 vars in 1062 bytes} [Sun Aug 7 18:12:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:32.878583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:32.880757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:32.901201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:32.985697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900d15-29db-4c86-9649-e9946d1d0840 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:33.058405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:33.059012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:33.059291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:33.059562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:33.061176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:33.131908 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:33.168586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:33.170034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eed73-1cc1-49b8-9ada-8bb44e790e20 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:33.188493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 658/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:35.467965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.468496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.468496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.469825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 668/1326] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:35.475417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed84f-12cc-42ac-90e5-e4669e5721c9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.475888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed84f-12cc-42ac-90e5-e4669e5721c9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.475994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed84f-12cc-42ac-90e5-e4669e5721c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.545952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ea2ed84f-12cc-42ac-90e5-e4669e5721c9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:35.547150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ea2ed84f-12cc-42ac-90e5-e4669e5721c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.661996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 659/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:35.698894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:35.700501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.760193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:35.803271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723d75f-394d-4615-9cbd-f864b2fb5606 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:35.874724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:35.875259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:35.875530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:35.875832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:35.877443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:35.984301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:35.986834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:35.988496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11da61-ce5b-48a7-9992-f930fa3b1e86 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:36.006953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 669/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:38.090953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:38.091470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:38.091470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:38.092819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 660/1329] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:38.098062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1062-8721-458b-8840-201ce6dc41ab None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:38.098467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1062-8721-458b-8840-201ce6dc41ab None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:38.098609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be1062-8721-458b-8840-201ce6dc41ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:38.179025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-29be1062-8721-458b-8840-201ce6dc41ab None None] MFA Rules not processed for user `c57f9edf97cc4625b9968af12791928b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:38.180231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-29be1062-8721-458b-8840-201ce6dc41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:38.285033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 670/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:38.323679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:38.325194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:38.355725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:38.434672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2e48a-ba22-41ec-aea2-3646b3470f3c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:38.509961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:38.510557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:38.510836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:38.511102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:38.512681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:38.592152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:38.624304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:38.625715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6427db-8979-4d70-93b5-25093e0d22ae service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:38.643809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 661/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:40.899059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:40.899501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:40.899629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:40.900955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 671/1332] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:40.905972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b37da-16cf-4a73-9ae3-2c65700055e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:40.906428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b37da-16cf-4a73-9ae3-2c65700055e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:40.906525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b37da-16cf-4a73-9ae3-2c65700055e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:40.970059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-848b37da-16cf-4a73-9ae3-2c65700055e7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:40.971237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-848b37da-16cf-4a73-9ae3-2c65700055e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:41.075457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 662/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:41.111951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:41.113581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:41.182100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:41.215917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40cad1-d350-4def-92d8-2f51b9dfd7c1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:41.286552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:41.287142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:41.287416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:41.287680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:41.289256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:41.402066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:41.403491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e8178-fae2-4c4b-869a-f75ef0d8df6a service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:41.413746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:41.422512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 672/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:43.495953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.496599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.496599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.497808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 663/1335] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:43.503254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef7a8-37cc-4065-984d-115a531e9046 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.503674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef7a8-37cc-4065-984d-115a531e9046 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.503814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef7a8-37cc-4065-984d-115a531e9046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.569077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-401ef7a8-37cc-4065-984d-115a531e9046 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:43.570281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-401ef7a8-37cc-4065-984d-115a531e9046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.662125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 673/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:43.702683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:43.704205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.744172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:43.806956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59db4b8-bba7-47f7-9e76-744a46751df0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:43.879223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:43.879820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:43.880096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:43.880364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:43.881961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:43.963672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:43.990396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:43.991824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77ba0-9844-4cd7-8e11-18c32ef23e95 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:44.012881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 664/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:46.655441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:46.655976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:46.655976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:46.657323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 674/1338] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:46.662516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc634e8-09f2-4ee6-9f6a-5c3c783290f2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:46.662902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc634e8-09f2-4ee6-9f6a-5c3c783290f2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:46.663052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc634e8-09f2-4ee6-9f6a-5c3c783290f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:46.727065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bcc634e8-09f2-4ee6-9f6a-5c3c783290f2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:46.728247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bcc634e8-09f2-4ee6-9f6a-5c3c783290f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:46.828322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 665/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:46.865204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:46.866757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:46.944653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:46.974192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82bf76-0a91-4eab-9b87-1c0674da7fb9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:47.046309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:47.046956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:47.047237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:47.047504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:47.049082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:47.155812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:47.157243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f62d9-d8d0-4960-8920-27c870ffc8a9 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:47.175816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 675/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:51.255382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:51.255954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:51.255954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:51.257645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 666/1341] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:51.263402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1507a-d0fb-45bd-9aa4-aca55937309c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:51.263834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1507a-d0fb-45bd-9aa4-aca55937309c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:51.263933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1507a-d0fb-45bd-9aa4-aca55937309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:51.269656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:51.332256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c1c1507a-d0fb-45bd-9aa4-aca55937309c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:51.333376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c1c1507a-d0fb-45bd-9aa4-aca55937309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:51.433316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 676/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:51.473278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:51.474948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:51.524206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:51.583417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb136-fcca-4e75-a038-138760e63db1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:51.658433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:51.659039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:51.659314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:51.659582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:51.661152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:51.757866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:51.779246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:51.780578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f8a61-631c-418d-805a-acc3a845e7fb service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:51.800770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 667/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:54.423240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:54.423822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:54.424067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:54.425479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 677/1344] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:54.431097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b8b4-ed6f-4f4c-a944-4414bcadb913 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:54.431618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b8b4-ed6f-4f4c-a944-4414bcadb913 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:54.431715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b8b4-ed6f-4f4c-a944-4414bcadb913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:54.501315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f610b8b4-ed6f-4f4c-a944-4414bcadb913 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:54.502552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f610b8b4-ed6f-4f4c-a944-4414bcadb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:54.607239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 668/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:54.648069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:54.649588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:54.734048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:54.752735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a345-ae8d-471c-bec3-782bf4c001bb None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:54.827888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:54.828492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:54.828761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:54.829021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:54.830966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:54.941562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:54.943038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba44f7-8f14-4ed6-91af-632d03948986 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:54.960634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 678/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:12:58.930989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.931513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.931513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.932841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 669/1347] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:12:58.938301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0eb6-6ca0-4e28-9881-59b4748d963b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:58.938762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0eb6-6ca0-4e28-9881-59b4748d963b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:58.938877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0eb6-6ca0-4e28-9881-59b4748d963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:58.955411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:59.007177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-232b0eb6-6ca0-4e28-9881-59b4748d963b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:12:59.008388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-232b0eb6-6ca0-4e28-9881-59b4748d963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:59.105394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 679/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:12:59.143307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:12:59.145447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:59.217256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:59.274264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98d69-51a7-4199-a914-25d56bb93eb5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:12:59.351001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:12:59.351610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:12:59.351884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:12:59.352186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:12:59.353778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:12:59.465168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:12:59.469938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:12:59.471378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313753fd-00b0-4851-8a14-db82343c5fa7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:12:59.490864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 670/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:04.431989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9809b-3a47-4c18-85a4-eee2dda5aecc None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.432792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9809b-3a47-4c18-85a4-eee2dda5aecc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.432792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9809b-3a47-4c18-85a4-eee2dda5aecc None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.434187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 680/1350] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:04.443571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0a57-4667-479b-9c55-198c33a3518e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:04.444235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0a57-4667-479b-9c55-198c33a3518e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:04.444235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0a57-4667-479b-9c55-198c33a3518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:04.548113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-556e0a57-4667-479b-9c55-198c33a3518e None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:04.549210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-556e0a57-4667-479b-9c55-198c33a3518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:04.684200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 671/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:08.907894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a5b7-db47-4c8c-9e52-7d197714ca49 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:08.908864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a5b7-db47-4c8c-9e52-7d197714ca49 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:08.909147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420a5b7-db47-4c8c-9e52-7d197714ca49 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:08.911371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 681/1352] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:08.916915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6aba-0928-433a-af38-08b8937a37c4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:08.917457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6aba-0928-433a-af38-08b8937a37c4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:08.917539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6aba-0928-433a-af38-08b8937a37c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:08.982657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:09.011737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a2be6aba-0928-433a-af38-08b8937a37c4 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:09.013762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2be6aba-0928-433a-af38-08b8937a37c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:09.103548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=59 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:09.130161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 672/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:13:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:10.250947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82fe9-ab15-4e9b-a8f1-93829be82a32 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:10.251456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82fe9-ab15-4e9b-a8f1-93829be82a32 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:10.251456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82fe9-ab15-4e9b-a8f1-93829be82a32 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:10.252908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 682/1354] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:10.258077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365e15-9468-4d6a-aa12-540a891af019 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:10.258511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365e15-9468-4d6a-aa12-540a891af019 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:10.258630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365e15-9468-4d6a-aa12-540a891af019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:10.334360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-99365e15-9468-4d6a-aa12-540a891af019 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:10.335553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-99365e15-9468-4d6a-aa12-540a891af019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:10.377176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:10.441866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 673/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:13.811060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774134e9-8b69-411f-9b93-9c992594e763 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:13.811886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774134e9-8b69-411f-9b93-9c992594e763 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:13.812306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774134e9-8b69-411f-9b93-9c992594e763 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:13.819437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 683/1356] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:13.821271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dbe25-3ed8-4419-9225-7ec3eb3d2389 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:13.822054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dbe25-3ed8-4419-9225-7ec3eb3d2389 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:13.822594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dbe25-3ed8-4419-9225-7ec3eb3d2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:13.907194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-484dbe25-3ed8-4419-9225-7ec3eb3d2389 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:13.908389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-484dbe25-3ed8-4419-9225-7ec3eb3d2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:14.013218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 674/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:14.073839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:14.074583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:14.075380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:14.077233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 684/1358] 10.222.0.30 () {54 vars in 962 bytes} [Sun Aug 7 18:13:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:14.090050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedfe7-b7a6-4257-9dc3-0c90257297f5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:14.090651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedfe7-b7a6-4257-9dc3-0c90257297f5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:14.091154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedfe7-b7a6-4257-9dc3-0c90257297f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:14.113767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:14.180553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ffaedfe7-b7a6-4257-9dc3-0c90257297f5 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:14.181959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ffaedfe7-b7a6-4257-9dc3-0c90257297f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:14.303213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 675/1359] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Aug 7 18:13:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:14.311350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:14.312905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:14.465337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2703f1f-ed29-427f-906a-8911c8ce0cd0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:14.542174 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:14.586469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:14.587070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:14.587348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:14.587622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:14.589188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:14.684413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:14.686240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee0d47-7e88-4236-acba-89a53ab4703d service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:14.714120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 685/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:13:16.930952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:16.931412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:16.931412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:16.932833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 676/1361] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:16.938640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42ee4-f224-4820-8851-238912af07f3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:16.939045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42ee4-f224-4820-8851-238912af07f3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:16.939204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42ee4-f224-4820-8851-238912af07f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:17.021891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0bc42ee4-f224-4820-8851-238912af07f3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:17.023035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0bc42ee4-f224-4820-8851-238912af07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:17.063758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:17.128956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 686/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:17.174701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:17.176344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:17.256394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:17.356377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa4a00-7de7-4399-b36d-ccfb6bf68186 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:17.512788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:17.513405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:17.513695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:17.513937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:17.515739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:17.658568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:17.730459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:17.732021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccd68-8cfc-4000-8017-17b0fd2e96f1 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:17.750991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 677/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:20.104363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edea12-f87d-4c33-8c1a-e1e63f8ac9f4 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:20.105445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edea12-f87d-4c33-8c1a-e1e63f8ac9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:20.106034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edea12-f87d-4c33-8c1a-e1e63f8ac9f4 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:20.107615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 687/1364] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:20.114846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d761-9605-4d58-8a82-c1173e536478 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:20.115764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d761-9605-4d58-8a82-c1173e536478 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:20.116232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d761-9605-4d58-8a82-c1173e536478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:20.188246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-79f6d761-9605-4d58-8a82-c1173e536478 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:20.189813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-79f6d761-9605-4d58-8a82-c1173e536478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:20.286875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:20.289967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 678/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:20.335288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:20.335564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:20.335831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:20.337289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 688/1366] 10.222.0.30 () {54 vars in 962 bytes} [Sun Aug 7 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:20.342994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8f2f-3917-47e6-b21e-7babaf9fa0e2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:20.343278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8f2f-3917-47e6-b21e-7babaf9fa0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:20.343544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8f2f-3917-47e6-b21e-7babaf9fa0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:20.435921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0e8f8f2f-3917-47e6-b21e-7babaf9fa0e2 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:20.437108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0e8f8f2f-3917-47e6-b21e-7babaf9fa0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:20.563180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 679/1367] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Aug 7 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:20.571297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:20.572899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:20.734642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8caae-53ee-4e95-a1f0-c868bd80155e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:20.756798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:20.858237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:20.858847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:20.859115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:20.859380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:20.860946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:20.964362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:20.966111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8501b5-c791-4d49-bdca-3eb00edf4c97 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:20.985589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 689/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:21.912393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557279b-a05c-4b16-aef9-872dd38445c9 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:21.912793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557279b-a05c-4b16-aef9-872dd38445c9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:21.913001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557279b-a05c-4b16-aef9-872dd38445c9 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:21.914566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 680/1369] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:21.919839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700d79-5747-4cbf-94db-bd238f8bcb12 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:21.920278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700d79-5747-4cbf-94db-bd238f8bcb12 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:21.920379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700d79-5747-4cbf-94db-bd238f8bcb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:21.955113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:21.993482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-53700d79-5747-4cbf-94db-bd238f8bcb12 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:21.994739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-53700d79-5747-4cbf-94db-bd238f8bcb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.109921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 690/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:22.474669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.475176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.475613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.477082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 681/1371] 10.222.0.30 () {54 vars in 964 bytes} [Sun Aug 7 18:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:22.482586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee03-1673-4568-92be-d543e2bf8665 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.483052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee03-1673-4568-92be-d543e2bf8665 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.483490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ee03-1673-4568-92be-d543e2bf8665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.561778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-91c1ee03-1673-4568-92be-d543e2bf8665 None None] MFA Rules not processed for user `45b5ef7c1c6a4698bd122c8d7327c723`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:22.563248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-91c1ee03-1673-4568-92be-d543e2bf8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.612622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.648493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 691/1372] 10.222.0.30 () {58 vars in 1061 bytes} [Sun Aug 7 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:22.656366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:22.657834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.710977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.769683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb96c6-f2fa-413d-bf09-6d364eafe5c2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:22.843932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:22.845009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:22.845494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:22.846127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:22.847797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:22.952693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:22.968094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:22.969260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f3ab8-21ba-48b9-add1-678cb294d1c7 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:22.988494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 682/1373] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:23.083677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:23.084191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:23.084664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:23.085553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 692/1374] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:23.091534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146793-a47c-4e5b-a7b5-9ebbf8f16c8c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:23.091951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146793-a47c-4e5b-a7b5-9ebbf8f16c8c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:23.092310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146793-a47c-4e5b-a7b5-9ebbf8f16c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:23.178116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-03146793-a47c-4e5b-a7b5-9ebbf8f16c8c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:23.179332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-03146793-a47c-4e5b-a7b5-9ebbf8f16c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:23.286240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 683/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:23.330753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:23.333146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:23.490219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465d133-b7d5-4967-85ab-e3c22ba49074 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:23.545269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:23.608237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:23.608899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:23.609272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:23.609546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:23.611254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:23.706794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:23.708367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce03dd-5155-4988-af50-5e9de1aaf3fd service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:23.727151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 693/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:25.767082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:25.767598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:25.767756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:25.770064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 684/1377] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:25.775438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec449b-0fa9-43d0-9b23-23b93148a896 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:25.775830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec449b-0fa9-43d0-9b23-23b93148a896 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:25.775920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec449b-0fa9-43d0-9b23-23b93148a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:25.847523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f2ec449b-0fa9-43d0-9b23-23b93148a896 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:25.848759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f2ec449b-0fa9-43d0-9b23-23b93148a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:25.855773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:25.963806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 694/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:26.015447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:26.017262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:26.078384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:26.163124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe164-b8ed-4f37-91f3-2c571c613721 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:26.281005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:26.281525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:26.281797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:26.282086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:26.283638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:26.302645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:26.387737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:26.389382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2818-764b-49b6-b101-6e24b8d880fd service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:26.407472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 685/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:28.474391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:28.474916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:28.474916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:28.476339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 695/1380] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:28.481387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4478-3b87-4f46-ab04-9c3850814e44 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:28.481814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4478-3b87-4f46-ab04-9c3850814e44 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:28.481948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4478-3b87-4f46-ab04-9c3850814e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:28.568169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-214d4478-3b87-4f46-ab04-9c3850814e44 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:28.569383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-214d4478-3b87-4f46-ab04-9c3850814e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:28.668388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:28.674662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 686/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:28.728466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:28.729875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:28.893423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:28.900090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd476d-305a-48dc-9711-6fedeaab92a1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:29.155794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:29.156485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:29.156821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:29.157145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:29.158920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:29.258012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:29.259812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc17232-abb8-47d5-ad87-96208f9ad8b0 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:29.271770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:29.281508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 696/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:31.607441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:31.608013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:31.608234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:31.610047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 687/1383] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:31.615842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc5a9f-2fc0-41b8-80c3-2cd733c0638a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:31.616414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc5a9f-2fc0-41b8-80c3-2cd733c0638a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:31.616414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc5a9f-2fc0-41b8-80c3-2cd733c0638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:31.682520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-9dbc5a9f-2fc0-41b8-80c3-2cd733c0638a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:31.683759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9dbc5a9f-2fc0-41b8-80c3-2cd733c0638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:31.781491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 697/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:31.824826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:31.826894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:32.013970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274321-cf6e-4e4b-9567-850ae93418d6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:32.080413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:32.128930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:32.129527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:32.129795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:32.130087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:32.131651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:32.231837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:32.233353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870f18-2464-407e-9b9f-2796efdb6c94 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:32.254013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 688/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:34.960930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:34.961510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:34.961510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:34.962901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 698/1386] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:34.968332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f502d0-f855-4285-8fcf-dc466c50acff None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:34.968917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f502d0-f855-4285-8fcf-dc466c50acff None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:34.968917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f502d0-f855-4285-8fcf-dc466c50acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:35.039524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-16f502d0-f855-4285-8fcf-dc466c50acff None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:35.040770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-16f502d0-f855-4285-8fcf-dc466c50acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:35.072706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:35.138873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 689/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:35.185637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:35.187205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:35.271513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:35.342211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a14c9e-456e-4933-96b7-c496f2c77add None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:35.458049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:35.458753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:35.459120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:35.459468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:35.461929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:35.505165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:35.558915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:35.560489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7b9fc-7883-40ff-a823-caf4525e5e64 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:35.579629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 699/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:37.710307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:37.710883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:37.710883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:37.712260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 690/1389] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:37.717767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b26a4-bb7f-4bd6-abde-ebf0cbf7aea7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:37.718192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b26a4-bb7f-4bd6-abde-ebf0cbf7aea7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:37.718346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b26a4-bb7f-4bd6-abde-ebf0cbf7aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:37.784560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e07b26a4-bb7f-4bd6-abde-ebf0cbf7aea7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:37.785759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e07b26a4-bb7f-4bd6-abde-ebf0cbf7aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:37.881308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 700/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:37.926462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:37.927967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.023391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947215de-b8db-46cd-b4b4-389c17331cba None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.023577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947215de-b8db-46cd-b4b4-389c17331cba None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.023850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947215de-b8db-46cd-b4b4-389c17331cba None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.025202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 701/1391] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:13:38.030118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509bcfc-50ae-46c4-b942-a684e792b4f6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.030397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509bcfc-50ae-46c4-b942-a684e792b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.030664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509bcfc-50ae-46c4-b942-a684e792b4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.045431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:38.078050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88eeca-c499-4f0e-9fcc-fa7bd0f9c789 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:38.095451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4509bcfc-50ae-46c4-b942-a684e792b4f6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:38.095640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:38.096656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4509bcfc-50ae-46c4-b942-a684e792b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.194975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:38.195588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.195987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.196263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.197417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 702/1392] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:38.202037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.252568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7781-9a22-4a4e-b6c8-7e6fdd082965 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.252848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7781-9a22-4a4e-b6c8-7e6fdd082965 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.253729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7781-9a22-4a4e-b6c8-7e6fdd082965 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.255107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 703/1393] 10.222.0.30 () {54 vars in 966 bytes} [Sun Aug 7 18:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:13:38.260173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a291e-598d-48d1-a7c2-42c594ebf66d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.260452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a291e-598d-48d1-a7c2-42c594ebf66d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.260719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a291e-598d-48d1-a7c2-42c594ebf66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.288910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:38.290429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:38.308726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 691/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:38.337809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-258a291e-598d-48d1-a7c2-42c594ebf66d None None] MFA Rules not processed for user `06607bda2bed4773af2dce7a16b5c141`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:38.339046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-258a291e-598d-48d1-a7c2-42c594ebf66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.377312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:38.426223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 704/1395] 10.222.0.30 () {58 vars in 1063 bytes} [Sun Aug 7 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:38.434430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:38.435659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.460432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:38.518179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1e098-b2d3-4a05-ab0a-567f45df6168 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:38.594022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:38.594628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:38.594897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:38.595154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:38.597258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:38.698421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:38.718366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:38.719792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8499f35-48e1-4356-9a38-50d5abcb1295 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:38.739342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 692/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:39.473147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c6-ca2d-4e55-9792-029b02e0b12b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:39.473666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c6-ca2d-4e55-9792-029b02e0b12b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:39.473666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c6-ca2d-4e55-9792-029b02e0b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:39.540585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-42fed8c6-ca2d-4e55-9792-029b02e0b12b None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:39.541670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-42fed8c6-ca2d-4e55-9792-029b02e0b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:39.627633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 705/1397] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:39.670645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:39.670934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:39.671204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:39.672592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 693/1398] 10.222.0.30 () {54 vars in 943 bytes} [Sun Aug 7 18:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:39.679423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0db-9480-481e-a568-cab5c11514da None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:39.679708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0db-9480-481e-a568-cab5c11514da None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:39.679979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141a0db-9480-481e-a568-cab5c11514da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:39.735609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:39.755985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8141a0db-9480-481e-a568-cab5c11514da None None] MFA Rules not processed for user `b88b0656b52c4945896874a40739b5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:39.757170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8141a0db-9480-481e-a568-cab5c11514da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:39.862077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 706/1399] 10.222.0.30 () {58 vars in 1040 bytes} [Sun Aug 7 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:13:39.871854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:39.873510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:40.007238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f97a6-ddb6-42c3-9e3b-3e7efebfa05d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:40.073335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:40.115459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:40.116955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:40.116955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:40.117158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:40.118690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:40.204223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:40.206149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27714-b6ae-4a11-9462-41432a4bbe7a service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:40.214325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 694/1400] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:13:40.397088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:40.397272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:40.397611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:40.399130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 707/1401] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:40.404408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004624d0-f9cb-4894-9bdd-0736df886f40 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:40.404696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004624d0-f9cb-4894-9bdd-0736df886f40 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:40.404971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004624d0-f9cb-4894-9bdd-0736df886f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:40.477854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-004624d0-f9cb-4894-9bdd-0736df886f40 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:40.481185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-004624d0-f9cb-4894-9bdd-0736df886f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:40.539707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:40.594928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 695/1402] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:40.639314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:40.640834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:40.754040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:40.798182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bcd12-eaf8-467c-98b5-d7d4fc067bee None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:40.934903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:40.935685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:40.936070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:40.936541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:40.938538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:41.017346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:41.040475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:41.042514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf7d0-9fb8-4b01-b52b-de5aad7e3434 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:41.062580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 708/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:43.183219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:43.183823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:43.183823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:43.184988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 696/1404] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:43.190305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eacd6-2999-4b20-a905-af6af1c24c70 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:43.191253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eacd6-2999-4b20-a905-af6af1c24c70 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:43.191344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eacd6-2999-4b20-a905-af6af1c24c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:43.263180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-604eacd6-2999-4b20-a905-af6af1c24c70 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:43.264413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-604eacd6-2999-4b20-a905-af6af1c24c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:43.373153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 709/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:43.419593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:43.421120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:43.582411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d6a4-8445-4413-b9a7-ab9b052ea19b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:43.623250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:43.709038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:43.709644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:43.709956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:43.710211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:43.711797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:43.811663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:43.813578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c5b4e-94ab-4dc3-ab07-190acde18cca service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:43.832978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 697/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:45.887850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:45.888400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:45.888400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:45.889770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 710/1407] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:13:45.895590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6661d3-802e-49a1-90a1-a2e91312e345 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:45.896634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6661d3-802e-49a1-90a1-a2e91312e345 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:45.896934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6661d3-802e-49a1-90a1-a2e91312e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:45.950269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:45.966769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-de6661d3-802e-49a1-90a1-a2e91312e345 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:13:45.967902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-de6661d3-802e-49a1-90a1-a2e91312e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:46.079790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 698/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:13:46.115904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:13:46.117423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:46.171738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:46.280976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c5889-6206-4346-a2db-93d5e1938f23 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:13:46.398292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:13:46.398895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:13:46.399164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:13:46.399430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:13:46.400999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:13:46.410449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:46.501772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:13:46.504246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa487b-31af-4ef1-9e07-48fcc02998b1 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:13:46.522861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 711/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:13:56.068830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=46 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:13:56.520217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=41 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:02.561865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0fa5-c75b-4285-aa34-6f881a46ebaa None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.562455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0fa5-c75b-4285-aa34-6f881a46ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.562455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0fa5-c75b-4285-aa34-6f881a46ebaa None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.563669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 699/1410] 10.222.0.30 () {54 vars in 918 bytes} [Sun Aug 7 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:02.568710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c73e2-7adc-4996-a298-dfc6c62788a4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.569132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c73e2-7adc-4996-a298-dfc6c62788a4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.569246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c73e2-7adc-4996-a298-dfc6c62788a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.644043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-107c73e2-7adc-4996-a298-dfc6c62788a4 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:02.645216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-107c73e2-7adc-4996-a298-dfc6c62788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:02.746978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 712/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Aug 7 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:02.761283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc12c-6d01-4bc6-9ab8-a07412f3ed64 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.761566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc12c-6d01-4bc6-9ab8-a07412f3ed64 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.761835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acc12c-6d01-4bc6-9ab8-a07412f3ed64 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.763167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 700/1412] 10.222.0.30 () {54 vars in 918 bytes} [Sun Aug 7 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:02.767792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe60c2-a97c-4753-94c5-dac2577c317d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:02.768098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe60c2-a97c-4753-94c5-dac2577c317d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:02.768366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe60c2-a97c-4753-94c5-dac2577c317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:02.839284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:02.841750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0bbe60c2-a97c-4753-94c5-dac2577c317d None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:02.843479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0bbe60c2-a97c-4753-94c5-dac2577c317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:02.959955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 713/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Aug 7 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:05.446324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.446859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.446859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.448088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:05.453346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebd46-8ff2-4f15-a2fa-f5db4474724f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.453761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebd46-8ff2-4f15-a2fa-f5db4474724f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.453921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebd46-8ff2-4f15-a2fa-f5db4474724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.518825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e86ebd46-8ff2-4f15-a2fa-f5db4474724f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:05.520011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e86ebd46-8ff2-4f15-a2fa-f5db4474724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:05.574506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:05.617731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:14:05.660965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:05.662519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:05.804948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e118-caf2-4fff-8721-cd3b6db44bda None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:05.879121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:05.919927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:05.920545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:05.920816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:05.921075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:05.922669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:06.014417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:06.015999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec078e-ad6e-4720-8087-bba90b816deb service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:06.033687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 702/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:06.930837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:06.931329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:06.931425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:06.932702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:06.937503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b66b1-1f87-4c15-b6ae-c41d6c49c0d5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:06.937957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b66b1-1f87-4c15-b6ae-c41d6c49c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:06.938072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b66b1-1f87-4c15-b6ae-c41d6c49c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:07.012941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-910b66b1-1f87-4c15-b6ae-c41d6c49c0d5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:07.014152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-910b66b1-1f87-4c15-b6ae-c41d6c49c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:07.040419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:07.109037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:07.261661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:07.263109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:07.413709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2f4e3-45cf-4196-b1ab-a21aab4e8905 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:07.453182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:07.526602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:07.527117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:07.527390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:07.527656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:07.529230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:07.615505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:07.617080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079ce2-8106-4dde-a894-fb294656db00 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:07.634495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 716/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:08.504160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c897-8620-4426-8126-38d28599d182 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:08.504742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c897-8620-4426-8126-38d28599d182 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:08.504742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044c897-8620-4426-8126-38d28599d182 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:08.506057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:08.510786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28b9-fc5e-400f-800d-b3e9b824ee1d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:08.511223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28b9-fc5e-400f-800d-b3e9b824ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:08.511320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda28b9-fc5e-400f-800d-b3e9b824ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:08.564400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:08.585537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-aeda28b9-fc5e-400f-800d-b3e9b824ee1d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:08.586752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aeda28b9-fc5e-400f-800d-b3e9b824ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:08.681102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:08.829884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044c897-8620-4426-8126-38d28599d182 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:08.831807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f044c897-8620-4426-8126-38d28599d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:08.975102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044c897-8620-4426-8126-38d28599d182 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:08.986728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:09.085724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:09.086356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:09.086630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:09.086892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:09.088456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:09.176670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:09.179309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ab1cb-bd42-4eaf-ba25-840fe8d7ea1f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:09.198323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 705/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:10.052338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:10.052861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:10.052861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:10.054164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:10.059246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d024fe-d797-40f3-8995-e457d536e5e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:10.059657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d024fe-d797-40f3-8995-e457d536e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:10.059791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d024fe-d797-40f3-8995-e457d536e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:10.079387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:10.135539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-15d024fe-d797-40f3-8995-e457d536e5e7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:10.136734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-15d024fe-d797-40f3-8995-e457d536e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:10.230657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:14:10.381099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:10.382632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:10.489672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:10.524646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f2b62-2966-42a7-901b-80b67f1e8fcc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:10.636114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:10.636633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:10.636908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:10.637172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:10.638788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:10.712408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:10.726299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:10.727880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d4d89-cf13-4912-b323-1f86f0bfdc7e service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:10.745229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 719/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:11.592909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:11.593482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:11.593482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:11.594802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:11.599941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e290b-7ced-47ee-8a81-8dc62f23ce26 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:11.600341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e290b-7ced-47ee-8a81-8dc62f23ce26 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:11.600483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e290b-7ced-47ee-8a81-8dc62f23ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:11.673619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b07e290b-7ced-47ee-8a81-8dc62f23ce26 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:11.674865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b07e290b-7ced-47ee-8a81-8dc62f23ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:11.769721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:11.922053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:11.923542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:12.008203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:12.068694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88151b-1d94-4e55-be55-7a4f6c3935bb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:12.177989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:12.178524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:12.178801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:12.179068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:12.180646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:12.227671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:12.268886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:12.270514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637e89b-62b6-413c-8f05-af225ec8a402 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:12.288504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 708/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:13.088995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:13.089576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:13.089576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:13.090909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:13.095742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b066f-d4b4-4bbf-ab25-13284888114d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:13.096130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b066f-d4b4-4bbf-ab25-13284888114d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:13.096278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b066f-d4b4-4bbf-ab25-13284888114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:13.171610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-943b066f-d4b4-4bbf-ab25-13284888114d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:13.172709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-943b066f-d4b4-4bbf-ab25-13284888114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:13.268193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:13.417117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:13.418692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:13.468683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:13.563297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c637a-53dd-42b1-9a3c-6786fe467bf4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:13.673729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:13.674362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:13.675154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:13.675420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:13.677000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:13.683728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:13.771259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:13.772758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545ef7-a879-4280-a345-7a3a813e362e service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:13.790698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 722/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:14.591096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:14.591764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:14.591764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:14.593077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:14.597859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51adbf1-fd70-49f7-aba9-ba20ae9d8f52 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:14.598344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51adbf1-fd70-49f7-aba9-ba20ae9d8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:14.598460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51adbf1-fd70-49f7-aba9-ba20ae9d8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:14.676599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d51adbf1-fd70-49f7-aba9-ba20ae9d8f52 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:14.678649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d51adbf1-fd70-49f7-aba9-ba20ae9d8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:14.749405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:14.778805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:14.928823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:14.930357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:14.947812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:15.075355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd804-c0ce-44d6-a5c6-1743d68743f4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:15.161126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:15.187027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:15.187627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:15.187933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:15.188202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:15.189780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:15.279032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:15.280610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1242141-61b4-4a4d-8c67-63ecd7fd6aee service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:15.298018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 711/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:16.097205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.097727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.097840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.099213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:16.104185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf1c0-37bc-48b3-99cb-03591b6b8dbf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.104616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf1c0-37bc-48b3-99cb-03591b6b8dbf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.104726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cf1c0-37bc-48b3-99cb-03591b6b8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.180260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b38cf1c0-37bc-48b3-99cb-03591b6b8dbf None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:16.181439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b38cf1c0-37bc-48b3-99cb-03591b6b8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.221173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:16.274756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:14:16.424042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:16.425481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.567869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543956-6c5a-4420-868e-56434ceae9a7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:16.622833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:16.680642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:16.681204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:16.681481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:16.681750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:16.683358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:16.770061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:16.771638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32919788-0371-4e96-ba38-3723b40c995e service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:16.789138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 725/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:17.591583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:17.592096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:17.592209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:17.593487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:14:17.599050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a277f-43d2-4b6d-ada2-8e263fba53f7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:17.599470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a277f-43d2-4b6d-ada2-8e263fba53f7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:17.599612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a277f-43d2-4b6d-ada2-8e263fba53f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:17.673248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-139a277f-43d2-4b6d-ada2-8e263fba53f7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:17.675036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-139a277f-43d2-4b6d-ada2-8e263fba53f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:17.677007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:17.770533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:17.926749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:17.928233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:18.068452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5644-9a7d-48b2-a414-23468cdb8c16 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:18.094280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:18.179247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:18.179852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:18.180128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:18.180395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:18.182005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:18.270758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:18.272348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f8037-8b36-4d4a-bbc6-cee5adf6fb30 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:18.289579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 714/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:20.167774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:20.168282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:20.168378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:20.169655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:20.175340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c348eb-dcf9-4385-a22a-eaa63345276f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:20.175768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c348eb-dcf9-4385-a22a-eaa63345276f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:20.175875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c348eb-dcf9-4385-a22a-eaa63345276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:20.215781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:20.240678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-72c348eb-dcf9-4385-a22a-eaa63345276f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:20.241858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-72c348eb-dcf9-4385-a22a-eaa63345276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:20.334801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:20.377111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:20.379868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:20.482264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90be40-10a4-4da2-81ed-954daa712661 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:20.513678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:20.556229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:20.556823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:20.557099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:20.557358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:20.558970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:20.664709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:20.666097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b32bf-7880-4d9d-8beb-6ff09b8d0ec8 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:20.684461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 728/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:22.819600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:22.820143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:22.820143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:22.821490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:22.826747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf05e7-f68b-4f2c-9a7f-16792e8aded4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:22.827179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf05e7-f68b-4f2c-9a7f-16792e8aded4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:22.827286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf05e7-f68b-4f2c-9a7f-16792e8aded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:22.892528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2bcf05e7-f68b-4f2c-9a7f-16792e8aded4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:22.893714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2bcf05e7-f68b-4f2c-9a7f-16792e8aded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:22.906137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:22.988939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:23.027226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:23.028736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:23.129779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9ace-7bba-44dd-b7a9-6290def1bfd1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:23.141813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:23.205346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:23.206589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:23.206864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:23.207130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:23.208717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:23.320074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:23.321485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7978985-2f08-45ff-808a-a6e20b5ed7dc service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:23.338775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 717/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:25.652095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:25.652664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:25.652664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:25.654003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:25.659831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987ac0-db82-46b7-a446-e11b3f6f9991 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:25.660237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987ac0-db82-46b7-a446-e11b3f6f9991 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:25.660341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987ac0-db82-46b7-a446-e11b3f6f9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:25.707523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:25.727556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-df987ac0-db82-46b7-a446-e11b3f6f9991 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:25.728755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df987ac0-db82-46b7-a446-e11b3f6f9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:25.822491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:25.862570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:25.864110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:25.966246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4ef98-d235-44ce-bcbc-eba84f1e0be0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:26.004545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:26.037538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:26.038154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:26.038428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:26.038690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:26.040247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:26.144517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:26.145967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed4025-bdce-4b96-8db4-d502c7cf6009 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:26.163597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 731/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:28.357027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:28.357596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:28.357596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:28.358912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:28.364784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4493b7-caa1-41f0-a718-093de8da4a5f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:28.365217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4493b7-caa1-41f0-a718-093de8da4a5f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:28.365329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4493b7-caa1-41f0-a718-093de8da4a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:28.428722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bb4493b7-caa1-41f0-a718-093de8da4a5f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:28.429923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bb4493b7-caa1-41f0-a718-093de8da4a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:28.450119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:28.523645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:28.562641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:28.564149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:28.667958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a06da-1521-48e8-a1e3-e85af24aefea None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:28.687529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:28.740768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:28.741364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:28.741638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:28.741931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:28.743507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:28.851657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:28.853060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26104-e8d3-4bf7-9bb6-d689a1cfd312 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:28.870835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 720/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:30.925712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:30.926229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:30.926350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:30.927621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:30.932776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce52e-6f7d-480e-b4a3-4263b5467066 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:30.933178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce52e-6f7d-480e-b4a3-4263b5467066 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:30.933322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce52e-6f7d-480e-b4a3-4263b5467066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:30.995826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:30.998850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8fdce52e-6f7d-480e-b4a3-4263b5467066 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:31.000580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8fdce52e-6f7d-480e-b4a3-4263b5467066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:31.093806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:31.132385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:31.133962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:31.235394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510ce3-63a3-409c-9154-92ec355b7fa2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:31.284122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:31.308702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:31.309295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:31.309567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:31.309830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:31.311429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:31.416750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:31.418241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaeb79-d439-422d-8404-275e6032c28b service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:31.435961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 734/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:33.466099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:33.466642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:33.466642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:33.467993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:33.473970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8d25-f7c5-40cd-b1c3-e9131996a220 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:33.474423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8d25-f7c5-40cd-b1c3-e9131996a220 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:33.474526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8d25-f7c5-40cd-b1c3-e9131996a220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:33.542198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6fcd8d25-f7c5-40cd-b1c3-e9131996a220 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:33.543378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6fcd8d25-f7c5-40cd-b1c3-e9131996a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:33.571343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:33.637516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:33.678144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:33.679647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:33.786995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5603-b967-4381-ba3b-ef866424a6cc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:33.814614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:33.858970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:33.859566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:33.859836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:33.860098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:33.861673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:33.967889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:33.969298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8802-fb3a-47d7-ba86-1c44e9b5ed82 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:33.987591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 723/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:36.066249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:36.066776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:36.066776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:36.068037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:36.073268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3e90-e99d-48e4-b386-97dd659f0ed6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:36.073714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3e90-e99d-48e4-b386-97dd659f0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:36.073813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3e90-e99d-48e4-b386-97dd659f0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:36.138266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ab3a3e90-e99d-48e4-b386-97dd659f0ed6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:36.139485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab3a3e90-e99d-48e4-b386-97dd659f0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:36.148336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:36.234596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:36.272757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:36.274356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:36.374820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217897-aa36-4e52-a03c-64ab88ab8f8c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:36.428274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:36.446380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:36.446971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:36.447239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:36.447500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:36.449045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:36.553638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:36.555101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec4c06-d4c2-41aa-8d61-e9e207f5f2b7 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:36.573438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 737/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:38.619579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:38.620144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:38.620144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:38.621522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:38.626657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6a23-f841-4439-ac51-e0f8d936318c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:38.627087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6a23-f841-4439-ac51-e0f8d936318c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:38.627223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6a23-f841-4439-ac51-e0f8d936318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:38.691067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0f5d6a23-f841-4439-ac51-e0f8d936318c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:38.692239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0f5d6a23-f841-4439-ac51-e0f8d936318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:38.730848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:38.787980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:38.825548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:38.827129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:38.930084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ce93-5608-41a2-a1de-9a5cec339a21 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:38.966410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:39.001336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:39.001957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:39.002236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:39.002502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:39.004072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:39.108932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:39.110376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4f938-c703-4243-aa89-d899f7d5f735 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:39.129291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 726/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:14:41.135099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:41.135670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:41.135670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:41.137214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:41.143740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8b7c-7817-466b-8b4e-328d62b97ca6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:41.144254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8b7c-7817-466b-8b4e-328d62b97ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:41.144254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8b7c-7817-466b-8b4e-328d62b97ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:41.208190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-71ce8b7c-7817-466b-8b4e-328d62b97ca6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:41.209362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-71ce8b7c-7817-466b-8b4e-328d62b97ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:41.226997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:41.303420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:41.340644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:41.342174 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:41.445064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddcb5e-c62e-42f8-97e1-72f9eec2fe42 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:41.511145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:41.519873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:41.520472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:41.520747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:41.521013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:41.522629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:41.629461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:41.630913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7f5a6-311e-4455-8b6c-2b51edaa5a48 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:41.648664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 740/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:43.623730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:43.624268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:43.624268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:43.625564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:14:43.630892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b10-dce8-4dc9-9829-8fed83a3df44 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:43.631276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b10-dce8-4dc9-9829-8fed83a3df44 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:43.631423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b10-dce8-4dc9-9829-8fed83a3df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:43.696020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-75603b10-dce8-4dc9-9829-8fed83a3df44 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:14:43.697201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-75603b10-dce8-4dc9-9829-8fed83a3df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:43.743852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:43.792744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:14:43.828885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:14:43.831034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:43.937812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320ae0f-7200-43f8-b3dc-c8b3eb8f95b3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:14:43.984156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:44.009675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:14:44.010299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:14:44.010578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:14:44.010844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:14:44.012404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:14:44.117785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:14:44.119231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc36e-3473-42b6-a28c-f2b58f061ed3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:14:44.137598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 729/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:14:53.790967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=22 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:14:54.135322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=66 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:03.560900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb26d-c4db-4292-9760-26a6b6922fe4 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:03.561448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb26d-c4db-4292-9760-26a6b6922fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:03.561448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb26d-c4db-4292-9760-26a6b6922fe4 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:03.562858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 742/1471] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:03.568470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b178dd-8301-4332-97c5-abaa2222c254 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:03.568904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b178dd-8301-4332-97c5-abaa2222c254 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:03.569006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b178dd-8301-4332-97c5-abaa2222c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:03.636705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-93b178dd-8301-4332-97c5-abaa2222c254 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:03.637883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-93b178dd-8301-4332-97c5-abaa2222c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:03.730878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 730/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:03.813743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:03.814076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:03.814984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:03.816328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 743/1473] 10.222.0.30 () {54 vars in 966 bytes} [Sun Aug 7 18:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:03.821146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f46dd-6bc2-4f8b-b7b3-78d1acd38c10 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:03.821426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f46dd-6bc2-4f8b-b7b3-78d1acd38c10 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:03.821696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f46dd-6bc2-4f8b-b7b3-78d1acd38c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:03.896192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-625f46dd-6bc2-4f8b-b7b3-78d1acd38c10 None None] MFA Rules not processed for user `06607bda2bed4773af2dce7a16b5c141`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:03.897381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-625f46dd-6bc2-4f8b-b7b3-78d1acd38c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:03.921825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:03.976873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 731/1474] 10.222.0.30 () {58 vars in 1063 bytes} [Sun Aug 7 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:03.984744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:03.986816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:04.086642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660490ff-6276-492e-8da0-8301dc86f5a3 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:04.156993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:04.157615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:04.157886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:04.158662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:04.160219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:04.213802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:04.267140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:04.268764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b659f-6e85-4838-82f9-70288d54efd5 service glance] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:04.286954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 744/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:06.359513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:06.360097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:06.360097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:06.361450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 732/1476] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:06.366920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6348c0-81a5-43e0-a5f4-2d4b267523e1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:06.367307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6348c0-81a5-43e0-a5f4-2d4b267523e1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:06.367492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6348c0-81a5-43e0-a5f4-2d4b267523e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:06.432426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-cf6348c0-81a5-43e0-a5f4-2d4b267523e1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:06.433621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-cf6348c0-81a5-43e0-a5f4-2d4b267523e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:06.528709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 745/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:06.551057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:06.552593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:06.676597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69982fd-ae8d-49a4-ab12-960a06e8f7c8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:06.723323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:06.769039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:06.769635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:06.769936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:06.770194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:06.770814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:06.772497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:15:06.772497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:15:06.772497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:15:06.773615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e0578-9d12-4f07-9660-123d457fff3c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:06.791495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 733/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Sun Aug 7 18:15:06 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:15:08.794973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:08.795565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:08.795565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:08.796846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 746/1479] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:08.802535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d967-be87-4122-9383-d41133e8310f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:08.802968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d967-be87-4122-9383-d41133e8310f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:08.803076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d967-be87-4122-9383-d41133e8310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:08.867607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6b07d967-be87-4122-9383-d41133e8310f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:08.868791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6b07d967-be87-4122-9383-d41133e8310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:08.963759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 734/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:09.007339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:09.008840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:09.018802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:09.153233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ad13-bd16-4189-ae68-250555852ae2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:09.231041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:09.263319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:09.263921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:09.264195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:09.264466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:09.266068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:09.354763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:09.356353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b3e62-60c4-4504-8cc0-fe9b61f08c64 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:09.373856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 747/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:11.561539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:11.562108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:11.562108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:11.563491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 735/1482] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:11.569364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a1cc-2082-4663-8723-c1ceb456b272 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:11.569944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a1cc-2082-4663-8723-c1ceb456b272 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:11.570218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a1cc-2082-4663-8723-c1ceb456b272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:11.637542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-acd4a1cc-2082-4663-8723-c1ceb456b272 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:11.638780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-acd4a1cc-2082-4663-8723-c1ceb456b272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:11.683891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:11.732913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 748/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:11.770141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:11.771688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:11.794698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:11.873807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ad8ff-c682-4206-aaa9-046877e90f6c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:11.946831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:11.947444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:11.947719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:11.947989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:11.949567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:12.029528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:12.064834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:12.066304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69579e-dff8-4b6d-85fd-abe3df5aeda7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:12.085782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 736/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:14.123184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:14.123756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:14.123756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:14.125051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 749/1485] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:14.130336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93cd5-8563-49a8-a62f-9ba0d1049d68 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:14.130750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93cd5-8563-49a8-a62f-9ba0d1049d68 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:14.130878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93cd5-8563-49a8-a62f-9ba0d1049d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:14.195388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b4b93cd5-8563-49a8-a62f-9ba0d1049d68 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:14.196578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b4b93cd5-8563-49a8-a62f-9ba0d1049d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:14.291490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 737/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:14.329565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:14.331629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:14.434416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aed36c-2f5c-442e-a077-e2ad7543e8d8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:14.505079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:14.506949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:14.507556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:14.508024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:14.508514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:14.510312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:14.616997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:14.618465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed6df5-22cb-45b7-9442-41d3653577bd service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:14.638172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 750/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:16.719493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:16.720103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:16.720103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:16.721888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 738/1488] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:16.727146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38c90-2dcc-4e45-af19-6a43897081a1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:16.727572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38c90-2dcc-4e45-af19-6a43897081a1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:16.727678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38c90-2dcc-4e45-af19-6a43897081a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:16.791451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-33f38c90-2dcc-4e45-af19-6a43897081a1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:16.792626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-33f38c90-2dcc-4e45-af19-6a43897081a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:16.842788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:16.896297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 751/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:16.941364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:16.942960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:16.978792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:17.046989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186ebe7-cb55-4645-8f00-719642e0d170 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:17.118665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:17.119263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:17.119537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:17.119803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:17.121371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:17.199839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:17.228285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:17.229742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e168889-2fb3-4d20-9835-c76309f0e7f7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:17.247900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 739/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:19.426278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:19.426848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:19.426848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:19.428132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 752/1491] 10.222.0.30 () {54 vars in 927 bytes} [Sun Aug 7 18:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:15:19.433260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d64c-f419-4644-8e80-da82ba625410 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:19.433691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d64c-f419-4644-8e80-da82ba625410 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:19.433795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d64c-f419-4644-8e80-da82ba625410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:19.499127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aec9d64c-f419-4644-8e80-da82ba625410 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:15:19.500312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aec9d64c-f419-4644-8e80-da82ba625410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:19.596443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 740/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Sun Aug 7 18:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:15:19.636112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:15:19.637619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:19.738226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e122-ab9e-4b0b-bbc0-f15af9f82f90 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:15:19.808987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:15:19.809583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:15:19.809857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:15:19.810156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:15:19.811721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:15:19.820515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:19.918076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:15:19.919502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f06db-1a16-48f8-bb3a-cc2a6797422e service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:15:19.937355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 753/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:15:29.594381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:15:29.935123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=50 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:29.441758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:29.442382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:29.442382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:29.515081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:29.516254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:29.609036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 741/1494] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:29.617097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:29.617579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:29.617683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:29.693855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:29.695014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:29.788682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 754/1495] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:29.793424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:29.794643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:29.805889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22c53f-c10d-4c7a-b871-7131e7d7c496 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:29.865605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:29.904540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:29.905149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:29.905428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:29.905734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:29.906489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:16:29.906793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:29.908174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:29.908174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:16:29.908174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:16:29.909349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:29.921255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 742/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:16:29.930115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:29.939653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547c03-7afb-4e7b-9c6e-8ad401643137 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:29.998923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:30.038004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:30.038607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.038883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.039152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.039775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:30.041504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:30.041504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:16:30.041504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:16:30.042736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:30.097629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 755/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:16:29 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:16:30.101821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:30.103432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:30.137694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602e9c1-ae62-46b5-8db8-ad6648efd847 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:30.231302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:30.231894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.232168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.232427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.233037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:30.234057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:30.234057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:16:30.234057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:16:30.235240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:30.275949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 743/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:16:30 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:16:30.280210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:30.281762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:30.343075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb6db8-57a1-4044-8e7b-c1e335a773a7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:30.424656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:30.435524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:30.436123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.436398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.436664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.437781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:30.438821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:30.438821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:16:30.438821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:16:30.439704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:30.451715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 756/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:16:30.456385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:30.457876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:30.469014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3f6d-3caa-426a-9e57-2d38b663c1cf admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:30.493115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:30.561706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:30.562758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.563025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.563282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.563903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:30.564918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:30.564918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:16:30.564918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:16:30.565784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852dcca-e677-4901-8a42-ffd620ed6373 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:30.577548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 744/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:16:30.582354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:30.583872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:30.617574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380bf3d-26c2-49e8-bdca-9e124f9c4171 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:30.710808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:30.711477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.711745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.712005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] PATH_INFO: `/v3/projects/e0847ed4f64b46b0973a1ad18571a91f/users/4316243849c74544a462a87c803020f8/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.732733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0847ed4f64b46b0973a1ad18571a91f, user_id=4316243849c74544a462a87c803020f8, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:30.733751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:30.733751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:16:30.733751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:16:30.736443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f600cf-934a-43f7-954d-51df5020cf87 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:30.759824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 757/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:16:30 2022] PUT /identity/v3/projects/e0847ed4f64b46b0973a1ad18571a91f/users/4316243849c74544a462a87c803020f8/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:30.772058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fa23-2798-4016-86b3-e833e9e2cdb8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.772345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fa23-2798-4016-86b3-e833e9e2cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.772620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fa23-2798-4016-86b3-e833e9e2cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.829441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5008fa23-2798-4016-86b3-e833e9e2cdb8 None None] MFA Rules not processed for user `4316243849c74544a462a87c803020f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:30.830573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5008fa23-2798-4016-86b3-e833e9e2cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:30.905436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 745/1502] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:16:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:30.918602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.918884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.919180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.920531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 758/1503] 10.222.0.30 () {54 vars in 964 bytes} [Sun Aug 7 18:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:16:30.925716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c64b-54d2-4fac-a0a6-5977b912b2ef None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:30.926029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c64b-54d2-4fac-a0a6-5977b912b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:30.926301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403c64b-54d2-4fac-a0a6-5977b912b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:30.956644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:31.001294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a403c64b-54d2-4fac-a0a6-5977b912b2ef None None] MFA Rules not processed for user `45b5ef7c1c6a4698bd122c8d7327c723`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:31.002509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a403c64b-54d2-4fac-a0a6-5977b912b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:31.075487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 746/1504] 10.222.0.30 () {58 vars in 1061 bytes} [Sun Aug 7 18:16:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:31.083326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:31.084816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:31.133549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:31.187032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f010c-f3d2-4832-a9ff-c7ef5f2f18b2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:31.257425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:31.258051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:31.258327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:31.258591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:31.260164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:31.355639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:31.356990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:31.360489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:31.374344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 759/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:16:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:16:31.420027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0b89-b797-4d47-8f26-d5a61333d208 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:31.420314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0b89-b797-4d47-8f26-d5a61333d208 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:31.420589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0b89-b797-4d47-8f26-d5a61333d208 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:31.421926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 747/1506] 10.222.0.30 () {52 vars in 830 bytes} [Sun Aug 7 18:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:16:31.425530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:31.426751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:31.522312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93fba-289d-4fb8-8a98-423bc5f34441 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:31.615364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:31.615907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:31.616175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:31.616437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] PATH_INFO: `/v3/users/4316243849c74544a462a87c803020f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:31.628324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4316243849c74544a462a87c803020f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:31.629339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:31.629339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:16:31.629339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:16:31.630581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:31.640064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:31.696435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4316243849c74544a462a87c803020f8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:31.706398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4316243849c74544a462a87c803020f8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:31.729499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4316243849c74544a462a87c803020f8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:31.743025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4316243849c74544a462a87c803020f8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:31.743469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4316243849c74544a462a87c803020f8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:31.748924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 760/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:16:31 2022] DELETE /identity/v3/users/4316243849c74544a462a87c803020f8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:31.753770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:31.754302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:31.754408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:31.809122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:16:31.810338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:31.886049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:31.900317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 748/1508] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:16:31.909787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:31.911027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:32.008800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a711d-6376-4abf-b087-905a37aedf52 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:32.065701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:32.086606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:32.087219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:32.087504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:32.087768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:32.089345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:32.196098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:32.197446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6e8c2-fcc0-4476-8aef-56437f4b6823 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:32.217432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 761/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:16:32.537528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:16:32.538782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:16:32.550763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef78d66-4d55-411f-b991-89b315957d85 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:16:32.646466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:16:32.647087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:16:32.647364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:16:32.647643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] PATH_INFO: `/v3/projects/e0847ed4f64b46b0973a1ad18571a91f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:16:32.658227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0847ed4f64b46b0973a1ad18571a91f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:16:32.659245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:16:32.659245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:16:32.659245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:16:32.660468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:16:32.720380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0847ed4f64b46b0973a1ad18571a91f', 'request_id': 'req-86360ece-478c-473f-bb49-92f10e34b6d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:32.733085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0847ed4f64b46b0973a1ad18571a91f', 'request_id': 'req-86360ece-478c-473f-bb49-92f10e34b6d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:32.742437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0847ed4f64b46b0973a1ad18571a91f', 'request_id': 'req-86360ece-478c-473f-bb49-92f10e34b6d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:32.764934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] The token cache is being invalidate because project e0847ed4f64b46b0973a1ad18571a91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:16:32.766072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:32.766320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-86360ece-478c-473f-bb49-92f10e34b6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:16:32.767619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 749/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:16:32 2022] DELETE /identity/v3/projects/e0847ed4f64b46b0973a1ad18571a91f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:16:42.215311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=62 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:16:42.763044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:17:53.475422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:53.476053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:53.476053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:53.478172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:17:53.483123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85cb9-7f69-41e3-8944-da21b0d1e05c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:53.483557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85cb9-7f69-41e3-8944-da21b0d1e05c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:53.483665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85cb9-7f69-41e3-8944-da21b0d1e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:53.565186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3eb85cb9-7f69-41e3-8944-da21b0d1e05c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:53.566390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3eb85cb9-7f69-41e3-8944-da21b0d1e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:53.670078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:17:53.822372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:17:53.824402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:53.947439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781584d8-706c-43b1-9b28-7c75ebf5dfeb None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:17:53.952766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:17:53.953361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:53.953633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:53.953918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:53.962477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:17:53.964079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555593-ea80-4862-a5d1-6ff548956159 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:17:53.973242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 763/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:17:54.793589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331ad5-7005-4ec3-b72c-0881a53e1d0f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:54.794212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331ad5-7005-4ec3-b72c-0881a53e1d0f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:54.794212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331ad5-7005-4ec3-b72c-0881a53e1d0f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:54.796409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:17:54.801606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f14a-52d3-4765-88c0-b70f9cca21f4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:54.802062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f14a-52d3-4765-88c0-b70f9cca21f4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:54.802244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f14a-52d3-4765-88c0-b70f9cca21f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:54.821741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-dee9f14a-52d3-4765-88c0-b70f9cca21f4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:54.822952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-dee9f14a-52d3-4765-88c0-b70f9cca21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:54.830617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:17:54.981578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f331ad5-7005-4ec3-b72c-0881a53e1d0f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:17:54.996401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f331ad5-7005-4ec3-b72c-0881a53e1d0f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:17:55.001778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:17:55.002402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:55.002677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:55.002957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:55.010943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:17:55.012551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b99f-cf2e-45ac-b353-6db0d3b5ba3f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:17:55.022392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 752/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:17:55.437773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ce0f5-2102-473e-aa05-62bc01797a07 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:55.438069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ce0f5-2102-473e-aa05-62bc01797a07 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:55.438337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ce0f5-2102-473e-aa05-62bc01797a07 None None] PATH_INFO: `/v3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:55.439613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 765/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sun Aug 7 18:17:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:17:55.447243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7ec8-f7de-4441-9997-6130d0a0e72c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:17:55.447529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7ec8-f7de-4441-9997-6130d0a0e72c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:17:55.447802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e7ec8-f7de-4441-9997-6130d0a0e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:17:55.504651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-353e7ec8-f7de-4441-9997-6130d0a0e72c None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:17:55.505832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-353e7ec8-f7de-4441-9997-6130d0a0e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:17:55.522858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:17:55.577588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 753/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 7 18:17:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:04.498291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f8a4-ff92-4dd7-a662-5eecfab1b27f None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:04.498797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f8a4-ff92-4dd7-a662-5eecfab1b27f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:04.498797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15f8a4-ff92-4dd7-a662-5eecfab1b27f None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:04.500106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 766/1519] 10.222.0.30 () {54 vars in 961 bytes} [Sun Aug 7 18:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:04.505234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7de5d-70d4-4d09-9d62-329a90f67865 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:04.505644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7de5d-70d4-4d09-9d62-329a90f67865 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:04.505754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7de5d-70d4-4d09-9d62-329a90f67865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:04.524642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-51d7de5d-70d4-4d09-9d62-329a90f67865 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:04.525792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-51d7de5d-70d4-4d09-9d62-329a90f67865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:04.534216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 754/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Aug 7 18:18:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:04.541744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f8a4-ff92-4dd7-a662-5eecfab1b27f None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:04.554889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15f8a4-ff92-4dd7-a662-5eecfab1b27f None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:04.560477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:04.561054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:04.561328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:04.561595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:04.569639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:04.571236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98921f-048b-4a67-8366-723a463dc317 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:04.580536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 767/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:06.268368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032391e4-f5f6-46ce-89b3-4116787464df None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:06.268915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032391e4-f5f6-46ce-89b3-4116787464df None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:06.268915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032391e4-f5f6-46ce-89b3-4116787464df None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:06.270411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:06.275602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea54a-0c0c-447e-97e6-69aa232cb496 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:06.276030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea54a-0c0c-447e-97e6-69aa232cb496 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:06.276128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaea54a-0c0c-447e-97e6-69aa232cb496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:06.295743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-beaea54a-0c0c-447e-97e6-69aa232cb496 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:06.296908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-beaea54a-0c0c-447e-97e6-69aa232cb496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:06.304698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:06.456326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032391e4-f5f6-46ce-89b3-4116787464df None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:06.471320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032391e4-f5f6-46ce-89b3-4116787464df None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:06.476772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:06.477369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:06.477647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:06.477946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:06.486605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:06.488181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebcc8a-35c6-4e35-a8ab-5caf1fe4dab0 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:06.497500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 756/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:07.319083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f3c5-51ed-4690-b0f3-67ec66b397eb None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:07.319622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f3c5-51ed-4690-b0f3-67ec66b397eb None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:07.319622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f3c5-51ed-4690-b0f3-67ec66b397eb None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:07.320862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 18:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:07.325687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf9cb-a514-44dd-9457-715b2c24eedf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:07.326170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf9cb-a514-44dd-9457-715b2c24eedf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:07.326277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf9cb-a514-44dd-9457-715b2c24eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:07.345325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f9daf9cb-a514-44dd-9457-715b2c24eedf None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:07.346518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f9daf9cb-a514-44dd-9457-715b2c24eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:07.354761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:07.504427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f3c5-51ed-4690-b0f3-67ec66b397eb None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:07.519411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f3c5-51ed-4690-b0f3-67ec66b397eb None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:07.524941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:07.526124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:07.526396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:07.526660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:07.534396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:07.535960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf857f-8334-4ff3-a46b-7861dc98126f service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:07.545275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 770/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:11.320456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.320967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.320967 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.322278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:11.327354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252049e4-5dd1-4d2e-b397-53c2cf1b40e6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.327786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252049e4-5dd1-4d2e-b397-53c2cf1b40e6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.327904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252049e4-5dd1-4d2e-b397-53c2cf1b40e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.346692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-252049e4-5dd1-4d2e-b397-53c2cf1b40e6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:11.347870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-252049e4-5dd1-4d2e-b397-53c2cf1b40e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:11.356108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:11.427781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:11.429460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:11.505957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79367e6c-d713-4185-bb14-faccee747cc6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:11.509457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:11.510072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:11.510346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:11.510609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:11.519168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:11.520822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841561-f98e-48aa-a6c3-1821388562f9 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:11.530327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 759/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:13.509958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dedd2-21a8-4599-a5bc-90008ca259ba None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:13.510511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dedd2-21a8-4599-a5bc-90008ca259ba None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:13.510511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dedd2-21a8-4599-a5bc-90008ca259ba None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:13.511814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:13.517347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a4b8-4aaa-474f-877d-96b29aa3834e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:13.517797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a4b8-4aaa-474f-877d-96b29aa3834e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:13.517936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a4b8-4aaa-474f-877d-96b29aa3834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:13.537453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2508a4b8-4aaa-474f-877d-96b29aa3834e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:13.538694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2508a4b8-4aaa-474f-877d-96b29aa3834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:13.546419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:13.581399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dedd2-21a8-4599-a5bc-90008ca259ba None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:13.592495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dedd2-21a8-4599-a5bc-90008ca259ba None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:13.596025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:13.596602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:13.596876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:13.597129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:13.607655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:13.609342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02a87-922a-41b7-b99a-473755c702bb service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:13.618452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 773/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:17.099632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.100208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.100208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.101498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:17.106687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0af1-3dfc-4d60-b86c-9d7e699bcca6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.107108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0af1-3dfc-4d60-b86c-9d7e699bcca6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.107202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0af1-3dfc-4d60-b86c-9d7e699bcca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.126441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8c5b0af1-3dfc-4d60-b86c-9d7e699bcca6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:17.127603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8c5b0af1-3dfc-4d60-b86c-9d7e699bcca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:17.135857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:17.437889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:17.439603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:17.502846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:18:17.516081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d558b6-bcfe-416f-8dcb-c9cfa17d55de None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:17.520065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:17.520671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:17.520944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:17.521212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:17.530658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:17.532075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db969-5a06-47e7-963e-464c61f3378b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:17.541861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 762/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:19.555801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:19.556913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:19.557021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:19.558310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 18:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:18:19.563459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d783f-9250-4d19-aa4c-8c9706e7833e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:19.563907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d783f-9250-4d19-aa4c-8c9706e7833e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:19.564016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d783f-9250-4d19-aa4c-8c9706e7833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:19.583090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-723d783f-9250-4d19-aa4c-8c9706e7833e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:18:19.584267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-723d783f-9250-4d19-aa4c-8c9706e7833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:19.591983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:18:19.898273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:18:19.900006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:18:19.913309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59627-4824-4b2b-939d-03b62f9151b8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:18:19.916802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:18:19.917390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:18:19.917678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:18:19.917955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:18:19.926652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:18:19.928056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29873f-3b9f-4a0e-98e1-70a652b8abc7 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:18:19.937666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 776/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:18:29.578409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=11 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:18:29.933615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:42.804825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:42.807033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:42.807033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:42.834850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:42.836543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:42.845245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 764/1540] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:42.854696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:42.855276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:42.855276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:42.889783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:42.891037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:42.905996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 777/1541] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:42.910668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:42.928302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbece78-28ca-474d-a4ce-18b67278125d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:42.936502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:42.937357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:42.937827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:42.938318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:42.939164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:42.939664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:42.941436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:42.961610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 765/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:42.970186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:42.981894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fb293-b419-4027-8271-2efa2ccb01dd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:42.988081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:42.988704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:42.988981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:42.989252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:42.989878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:42.992354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.056198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 778/1543] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:43.060966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.079419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65c58-42eb-4f1a-b20e-86dfb4c9ca24 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.175408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.176395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.176864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.177322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.178165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.180349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.212341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 766/1544] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:43.216225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.234796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c069192-796c-4962-8ec7-d82f0170911c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.243952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.244709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.244992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.245271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.245929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.247551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.262876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 779/1545] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:43.266959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.279175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc159-22f8-4949-8e75-5abf34b78194 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.288555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.289968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.290441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.290908 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.291742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.293530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170c46-6b59-401d-88ea-24d80007a638 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.306994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 767/1546] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:43.311036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.326008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0cbfe-a9aa-403f-9757-1bb93388675f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.334686 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.335885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.336171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.336442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] PATH_INFO: `/v3/projects/829f865a21044020951f494ebc9e6edf/users/7bd39d1cce924d77979ded850bbfbea4/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.362514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829f865a21044020951f494ebc9e6edf, user_id=7bd39d1cce924d77979ded850bbfbea4, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.365195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ac4a-0a00-45d9-bfd9-2485aafd55f8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.393557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 780/1547] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:43 2022] PUT /identity/v3/projects/829f865a21044020951f494ebc9e6edf/users/7bd39d1cce924d77979ded850bbfbea4/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:43.400262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2f78-8eaa-4ccb-81ba-19478ca736da None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.400827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2f78-8eaa-4ccb-81ba-19478ca736da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.401315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a2f78-8eaa-4ccb-81ba-19478ca736da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.432646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8d9a2f78-8eaa-4ccb-81ba-19478ca736da None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.434230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8d9a2f78-8eaa-4ccb-81ba-19478ca736da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.440891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046e1-bfa5-438d-8b0b-cb188178ab3f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.441173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046e1-bfa5-438d-8b0b-cb188178ab3f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.441456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046e1-bfa5-438d-8b0b-cb188178ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.481062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-612046e1-bfa5-438d-8b0b-cb188178ab3f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.482776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-612046e1-bfa5-438d-8b0b-cb188178ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.519864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 768/1548] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.521203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a22acb-89f3-4192-bcf6-84502eff5801 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.521486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a22acb-89f3-4192-bcf6-84502eff5801 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.522481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a22acb-89f3-4192-bcf6-84502eff5801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.542825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-34a22acb-89f3-4192-bcf6-84502eff5801 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.544378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-34a22acb-89f3-4192-bcf6-84502eff5801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.548620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 781/1549] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.551194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d087-b8ab-4c90-b15b-169201ae8647 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.551576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d087-b8ab-4c90-b15b-169201ae8647 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.551848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d087-b8ab-4c90-b15b-169201ae8647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.558099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 769/1550] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.559414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb9bd-d3d2-4a34-b513-e4a21ebe96bc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.559979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb9bd-d3d2-4a34-b513-e4a21ebe96bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.560266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb9bd-d3d2-4a34-b513-e4a21ebe96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.572414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3311d087-b8ab-4c90-b15b-169201ae8647 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.573601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3311d087-b8ab-4c90-b15b-169201ae8647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.579514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-400cb9bd-d3d2-4a34-b513-e4a21ebe96bc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.580651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-400cb9bd-d3d2-4a34-b513-e4a21ebe96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.581459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 782/1551] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.582668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78a2c-cbc4-43b5-8a09-e3bd049b4db7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.582945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78a2c-cbc4-43b5-8a09-e3bd049b4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.583214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78a2c-cbc4-43b5-8a09-e3bd049b4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.594698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 770/1552] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.595909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.596188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.596454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.604078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f6c78a2c-cbc4-43b5-8a09-e3bd049b4db7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.605445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f6c78a2c-cbc4-43b5-8a09-e3bd049b4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.616346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 783/1553] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.617894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9bb75-a6f4-4c99-afb2-050dad9b07a8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.618074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.618357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9bb75-a6f4-4c99-afb2-050dad9b07a8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.618892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9bb75-a6f4-4c99-afb2-050dad9b07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.619243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.627711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 771/1554] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.634478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.641696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c9e9bb75-a6f4-4c99-afb2-050dad9b07a8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.642985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c9e9bb75-a6f4-4c99-afb2-050dad9b07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.652335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 784/1555] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.653337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c2d2-29ba-42bb-9735-46688b54391d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.653613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c2d2-29ba-42bb-9735-46688b54391d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.653882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03c2d2-29ba-42bb-9735-46688b54391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.672410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-af03c2d2-29ba-42bb-9735-46688b54391d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.673654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-af03c2d2-29ba-42bb-9735-46688b54391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.678801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:43.682208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 785/1556] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.683628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43dd6-0fa6-4d27-8777-eaf0c8c67e1d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.683777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43dd6-0fa6-4d27-8777-eaf0c8c67e1d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.684029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43dd6-0fa6-4d27-8777-eaf0c8c67e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.693045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0985-ca6e-4788-9fed-1efc1f6a715d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.697220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.697823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.698140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.698403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.703054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a4a43dd6-0fa6-4d27-8777-eaf0c8c67e1d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.704255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a4a43dd6-0fa6-4d27-8777-eaf0c8c67e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.707256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.708669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878767f-2320-4095-b8ad-4b3b5c55eff2 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.712727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 786/1557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.713874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2481-fc86-400d-82b6-bc609888eecc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.714181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2481-fc86-400d-82b6-bc609888eecc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.714447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2481-fc86-400d-82b6-bc609888eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.718926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 772/1558] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:43.720109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c9a5-8bc1-403f-9bc4-5e7baae13c86 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.720394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c9a5-8bc1-403f-9bc4-5e7baae13c86 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.720645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191c9a5-8bc1-403f-9bc4-5e7baae13c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.732765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-42ef2481-fc86-400d-82b6-bc609888eecc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.733990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-42ef2481-fc86-400d-82b6-bc609888eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.739068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0191c9a5-8bc1-403f-9bc4-5e7baae13c86 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.740211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0191c9a5-8bc1-403f-9bc4-5e7baae13c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.742830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 787/1559] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.747535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.747890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.748149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.753766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 773/1560] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.753766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be365-f512-4b14-9d2d-725511cf747f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.753766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be365-f512-4b14-9d2d-725511cf747f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.753766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be365-f512-4b14-9d2d-725511cf747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.772246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-082be365-f512-4b14-9d2d-725511cf747f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.772884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.773746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-082be365-f512-4b14-9d2d-725511cf747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.774204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.781773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 774/1561] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.786750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.786906 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 788/1562] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.786995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.786995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.787142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.797282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03a131-e211-4b93-a9c9-fdc790c000d4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.803191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.803872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:43.804001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.804681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.804989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.805657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.805778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:43.806284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.807221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:43.807221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:19:43.807221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:19:43.808321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.814304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 775/1563] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:43.820898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.831322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 789/1564] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.831322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.831634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f82c6d-896d-4be8-a34d-24b57361ea05 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.836087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6bde-1d2d-45c0-be32-dce3eb4b264a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.836921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.837583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.837865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.838176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.838895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.839221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.840869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.841615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.842328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.842679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.843022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.843736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.844134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.845782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.853451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 776/1565] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.855559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.868496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 790/1566] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.868496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.878377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed321d-91ef-47f6-97fa-75094a0b7b08 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.887481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.887481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.887481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.887481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.888132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.888132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.888132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.893710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d60bf-946c-4922-9194-2f64728f47a4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.899413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.900057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.900226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.900691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.901328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.901659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.903230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 777/1567] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.903320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.904226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.918174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34803b4-ab0d-4566-866f-bb15e4741b71 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.924180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.924790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.925066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.925332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.926167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.927016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.935264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 791/1568] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.935712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.935803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.938356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:43.943753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 778/1569] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.946565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d57d8c-7f26-45a8-a4cd-ecb08d11dbf5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.951798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.952063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.952678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.952968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.953243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.954163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:43.954564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.956516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.963649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99076496-75d8-4be4-8bfb-90fc5d3ceaa4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.969259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.969857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.970166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.970441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:43.978121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:43.978305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 792/1570] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:43.978409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:43.978409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:19:43.978409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:19:43.978637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:43.978735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:43.991470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea10c5-a954-4659-9a89-6b0939a6ae70 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:43.998280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:43.999237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:43.999590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:43.999865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.000483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.002749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.013987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 779/1571] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.013987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.035764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 793/1572] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:43 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.036430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.089322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6398d6-3e01-45c6-a231-193e6358b237 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.121693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c967791-8877-4ebb-a80a-718fdc310cbc admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.127532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.128142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.128416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.128679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.129512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.132005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.155341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.155952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.156225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.156591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.158027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.159894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.166237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 794/1573] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.170361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.175881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:44.193839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 780/1574] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.195338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.254249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35398c4-1153-418b-95f8-d5c4078fdc62 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.272266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46f1-66d2-4187-b7f7-d702897150e9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.277811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.278627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.278904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.279178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.279879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.281866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.313113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 781/1575] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.313979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.327247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.328244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.328463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.328737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.329367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.331339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.337802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:44.367179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 795/1576] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.367962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.391289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f866-cd4b-4839-b167-caa0a42be058 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.448368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296758f-0274-4991-9e20-99511e1a4227 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.456185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.457332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.465582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.466850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.466850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.466850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.467611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.467739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.468192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.469031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.469675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.471117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:44.471117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:19:44.471117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:19:44.473285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.505979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 796/1577] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.506875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 782/1578] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.507011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.509554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.521302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f735c0-42a7-46f0-8cb3-8c8d56d2b115 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.527727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:44.597251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df929-de91-4ebe-9f66-16705b512400 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.601067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.601845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.602151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.602424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.603060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.604414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.604860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.605265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.605386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.605619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.606527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.610039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.635895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 797/1579] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.635895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.647209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 783/1580] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.647922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.658687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256079-0897-44ca-ad1c-45fc6a9b4d52 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.660418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1aa1-f71b-4f5d-bc2e-edacb396f057 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.663705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.664375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.664594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.664865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.665492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.665871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.666642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.666921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.667187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.667459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.667796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.669879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.698869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 798/1581] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.700814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.712047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5494c-9181-45d1-8225-783ece78322a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.716644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 784/1582] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.720030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.721126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.722909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.726313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.726866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.727964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.730482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.732306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965b87-1fcd-4dc8-b382-5872e30aea84 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.737754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.738398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.738672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.738938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.739555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.742337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.762184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 799/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 303 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.762940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.772712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 785/1584] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:44 2022] POST /identity/v3/users => generated 296 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:44.776570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.779220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340e211-a199-4edd-8067-f28423857596 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.786126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.787181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.787370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.787945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.788568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711dca4-84e4-4eb4-a1fb-421a1393798c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.789180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.791093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.794341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.795041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.795334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.795657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.796387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.798113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.806192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 800/1585] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.807220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.818284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 786/1586] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.818284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.819567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db6ec8-81a7-413b-960b-c5710900ecfb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.825095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.825694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.826117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.826387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.827070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.828875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.831472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349adc5b-4d6c-4cdf-9288-de7a723912ad admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.836894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.837510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.837788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.838152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.838794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.840479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 801/1587] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.840611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.841265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.852745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e98ce-2afb-4103-9ff7-c08d6adc83ba admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.853247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 787/1588] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.854360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.857852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.858483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.858896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.859169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.860554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.861888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.863534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:44.866520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70aaeb-10e4-4589-bb4e-86115c2531ca admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.874638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.877937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 802/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.878392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.878496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.878577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.878577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.878577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.879874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.891417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a44a12-d7ad-44a2-8d14-c1bb3c6eb0c1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.895946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 788/1590] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.897100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.900190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.900477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.901107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.901382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.902062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.904304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.909393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b45ed3-a10a-4778-a111-934b31fa8388 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.916255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.917191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.917525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 803/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.918406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.921151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.921519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.922193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.923852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.932034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007331d-8d58-4747-bddb-4336b3165262 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.937509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.938147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.938432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.938682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.939312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.944016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.944691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 789/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.946400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.957440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 804/1593] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.958185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa733bcf-92c0-465c-9164-e22584ea350c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.958332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.963317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.964080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.964462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.964976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.966036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.968097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.975717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91a4c7-4866-4958-b2e4-d4d399aeba26 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:44.979894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 790/1594] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:44.980832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:44.984577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:44.985291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:44.985635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:44.986086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:44.987290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:44.989614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:44.992491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443ed1-e835-4f96-8830-16de1ad08c5c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.002618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.003580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.004028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.004475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.005451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.007534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.009191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 805/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:45.010227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.021932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f03498-7f25-4fa3-a2fa-813b668f35a3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.023977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 791/1596] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:45.029493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.034019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.034946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.035437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.035958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.036985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.040276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.044115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a889e-90e6-4be5-a376-114acea83df7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.053739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.055055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.055338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.055615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.056441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.056704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 806/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:45.057950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.058433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.069738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1ca3-425c-459e-9994-bcf317356e9f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.072331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 792/1598] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:45.077841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.080107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.081193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.081585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.081806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] PATH_INFO: `/v3/projects/4c1d1a259a3147559534e98a7124d5a3/users/c5e4c29a035f4e618bec79205cc3febe/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.093356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266a5e-5531-4912-a2f8-d3536692dc41 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.098962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.100005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.100485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.101530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] PATH_INFO: `/v3/projects/7dde615a554d4496ab2c516764e4a858/users/e002e42dfdf446b49fd421f55c8cee25/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.107755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1d1a259a3147559534e98a7124d5a3, user_id=c5e4c29a035f4e618bec79205cc3febe, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.110574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.122601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dde615a554d4496ab2c516764e4a858, user_id=e002e42dfdf446b49fd421f55c8cee25, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.124611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:45.124611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:19:45.124611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:19:45.127066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.132598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 807/1599] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/4c1d1a259a3147559534e98a7124d5a3/users/c5e4c29a035f4e618bec79205cc3febe/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.133767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.145974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 793/1600] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/7dde615a554d4496ab2c516764e4a858/users/e002e42dfdf446b49fd421f55c8cee25/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.147148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.180660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:45.235799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8bc1-18cd-4f92-b288-141dd8079e9c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.241131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.241879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.242179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.242734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] PATH_INFO: `/v3/projects/fd5aca063bbd4b09a600c9ded1d13b7d/users/44c4934c09544508aed2a43f9143d105/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.250707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721178b7-ccc6-41ce-aceb-8ea4b7887ee6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.256630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.257723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.258125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.258690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] PATH_INFO: `/v3/projects/0671e091118a45e8a5dbe85f9a7dcf76/users/ac719afc003945c7ab9fa308946b23ec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.263667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5aca063bbd4b09a600c9ded1d13b7d, user_id=44c4934c09544508aed2a43f9143d105, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.267493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.275780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0671e091118a45e8a5dbe85f9a7dcf76, user_id=ac719afc003945c7ab9fa308946b23ec, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.279246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.290512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 794/1601] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/fd5aca063bbd4b09a600c9ded1d13b7d/users/44c4934c09544508aed2a43f9143d105/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.291580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.309307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 808/1602] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/0671e091118a45e8a5dbe85f9a7dcf76/users/ac719afc003945c7ab9fa308946b23ec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.310375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.408406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564024a1-37d1-423b-a7d4-64264d7c2253 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.442459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf378393-02ae-4ba9-8352-63f7bb9fa21d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.448693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.449508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.449889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.450349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] PATH_INFO: `/v3/projects/b40cec6f8b4d4e06a0a4b1f4b6693589/users/c537e185798d46939404523314221295/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.472002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40cec6f8b4d4e06a0a4b1f4b6693589, user_id=c537e185798d46939404523314221295, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.474942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.478210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:45.493408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.494290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.494569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.494878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] PATH_INFO: `/v3/projects/8f969970eb4b4ae685217c1daafea598/users/5fa9ee4262b1424e8ef96517c4c2df21/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.495395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 809/1603] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/b40cec6f8b4d4e06a0a4b1f4b6693589/users/c537e185798d46939404523314221295/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.495989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.517326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f969970eb4b4ae685217c1daafea598, user_id=5fa9ee4262b1424e8ef96517c4c2df21, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.520461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e19ba2-ee2b-42a3-bf95-36d8db6df2ac admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.538296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 795/1604] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/8f969970eb4b4ae685217c1daafea598/users/5fa9ee4262b1424e8ef96517c4c2df21/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.541378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde45d51-ec8d-41ab-a6a3-869bb5fee896 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.541961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde45d51-ec8d-41ab-a6a3-869bb5fee896 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.542387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde45d51-ec8d-41ab-a6a3-869bb5fee896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.640784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bde45d51-ec8d-41ab-a6a3-869bb5fee896 None None] MFA Rules not processed for user `c5e4c29a035f4e618bec79205cc3febe`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.640784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bde45d51-ec8d-41ab-a6a3-869bb5fee896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.642883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87e5f-3732-4d42-92d0-bf1fcb49bf3c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.643217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:45.711026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 796/1605] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:45.713011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1877cb-a5b2-40b7-9958-ee168b232980 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.713293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1877cb-a5b2-40b7-9958-ee168b232980 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.713564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1877cb-a5b2-40b7-9958-ee168b232980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.723249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.727173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.727591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.727865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] PATH_INFO: `/v3/projects/69492e94802e4f43b8c3da76220beb4d/users/c2d6b067b6c24b53957ef39d3d00242b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.738301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1c1877cb-a5b2-40b7-9958-ee168b232980 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.739834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1c1877cb-a5b2-40b7-9958-ee168b232980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.750567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 797/1606] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:45.752220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ed97-bd69-4f93-bb11-f0560271a2ef None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.752627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ed97-bd69-4f93-bb11-f0560271a2ef None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.753007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ed97-bd69-4f93-bb11-f0560271a2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.753412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=69492e94802e4f43b8c3da76220beb4d, user_id=c2d6b067b6c24b53957ef39d3d00242b, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.756963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c39c-ae10-4d43-9ccc-2eb590efc8df admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.774742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 810/1607] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:45 2022] PUT /identity/v3/projects/69492e94802e4f43b8c3da76220beb4d/users/c2d6b067b6c24b53957ef39d3d00242b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:45.775841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada9ec-2724-4f38-849c-4a9b621ed4c1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.776124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada9ec-2724-4f38-849c-4a9b621ed4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.776388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada9ec-2724-4f38-849c-4a9b621ed4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.786673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6913ed97-bd69-4f93-bb11-f0560271a2ef None None] MFA Rules not processed for user `44c4934c09544508aed2a43f9143d105`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.787903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6913ed97-bd69-4f93-bb11-f0560271a2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.801267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e7ada9ec-2724-4f38-849c-4a9b621ed4c1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.802529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e7ada9ec-2724-4f38-849c-4a9b621ed4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.860419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 798/1608] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:45.862014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.862936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.863331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.876667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 811/1609] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:45.878362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5f72-8270-41d7-b73c-aa7d46f165ff None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.878962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5f72-8270-41d7-b73c-aa7d46f165ff None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.879253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5f72-8270-41d7-b73c-aa7d46f165ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.912403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.913525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.922093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 799/1610] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:45.922955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.940727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5b6c-732f-4b29-93fe-4a9cf2d3d95a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:45.943127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c25b5f72-8270-41d7-b73c-aa7d46f165ff None None] MFA Rules not processed for user `5fa9ee4262b1424e8ef96517c4c2df21`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:45.944325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c25b5f72-8270-41d7-b73c-aa7d46f165ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:45.946735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:45.947352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:45.947630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:45.948426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:45.948556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:45.950599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:45.958409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:45.990841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 800/1611] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:45.997554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:45.999547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:46.039816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 812/1612] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:46.041071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.041351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.041613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.065989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:46.068092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:46.088079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3a9ce-eae8-4402-b79d-7ddead488e4a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.094671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.095333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.095612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.095883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.161723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:46.191289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 813/1613] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:46.192976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.217711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.223644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605ead-0c8f-4c02-94f9-ba3d1ba2452f service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.225271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a09ce-0101-4a65-b325-1ca1a6690d49 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.233353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.234156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.234532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.234923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.245590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 801/1614] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:46.249023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399a02-0cc0-476c-9679-52655dba8870 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.249310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399a02-0cc0-476c-9679-52655dba8870 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.249577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50399a02-0cc0-476c-9679-52655dba8870 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.253183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 802/1615] 10.222.0.30 () {54 vars in 962 bytes} [Sun Aug 7 18:19:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:19:46.255708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50399a02-0cc0-476c-9679-52655dba8870 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.258772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.260271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.279263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50399a02-0cc0-476c-9679-52655dba8870 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.283044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.284085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.284446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.284824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.285688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 814/1616] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:46.287128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.296571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.298092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.314006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab585ac-cd47-4e54-9ff1-8c8f73a6876c service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.318719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 803/1617] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:46.320303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.325660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.326574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.328330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.328757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.329540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.334518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.397069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 815/1618] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:46 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:46.398650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.421181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077bf8-1cd5-4785-9a0c-07840848c1f3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.439040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.439949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.440392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.442276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.452199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae37f03-2126-4371-8739-469d3b6a4c28 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.475942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.477014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.478298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.478687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.479028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.479381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d426c73-b260-40b4-8f57-df6f165b33f1 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.498058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 816/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:46.509201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.510266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.510590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.612989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:46.614253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:46.674388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.676497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.708443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 804/1620] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:46.708443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.735259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452f3bb-cde4-4e34-923b-d230b95a23f9 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.747545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.748510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.748788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.749056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.749884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.752840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.778043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 805/1621] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:46.782137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.796365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:46.805378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d944675-094e-4d13-8b5c-2b6795bbac5d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.818522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.821476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.822612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.823680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] PATH_INFO: `/v3/projects/bce72f2727f04d428722829c10a1f4e6/users/c00f0422c7904745ac47fd33b8dd3eea/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.834507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 817/1622] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Aug 7 18:19:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:46.844916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:46.868013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce72f2727f04d428722829c10a1f4e6, user_id=c00f0422c7904745ac47fd33b8dd3eea, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:46.875622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6044-efe6-4bc5-81db-3459b19ab89c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:46.879508 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:46.894836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:46.895691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:46.896102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:46.896508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:46.912276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 806/1623] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:46 2022] PUT /identity/v3/projects/bce72f2727f04d428722829c10a1f4e6/users/c00f0422c7904745ac47fd33b8dd3eea/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:46.916161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:47.011890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:47.046668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:47.051499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:47.077778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8048f-de7c-4d0e-9a8b-348187c66cc6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:47.093984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 818/1624] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:47.104288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:47.105775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.107649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.107986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.108661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:47.121367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c6108-b68c-4054-9dcf-9d43cdb7c7cf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:47.151435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 807/1625] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:47.152904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:47.170110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87440022-6ae2-4929-a56c-750df32d17d8 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:47.181591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:47.182303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.182752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.183069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] PATH_INFO: `/v3/projects/bce72f2727f04d428722829c10a1f4e6/users/c00f0422c7904745ac47fd33b8dd3eea/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.188465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce72f2727f04d428722829c10a1f4e6, user_id=c00f0422c7904745ac47fd33b8dd3eea, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:47.196986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:47.233960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 819/1626] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:47 2022] PUT /identity/v3/projects/bce72f2727f04d428722829c10a1f4e6/users/c00f0422c7904745ac47fd33b8dd3eea/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:47.237119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f08ce-7c17-4cca-b354-ed66e8997328 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.238222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f08ce-7c17-4cca-b354-ed66e8997328 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.238689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f08ce-7c17-4cca-b354-ed66e8997328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.308074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ab2f08ce-7c17-4cca-b354-ed66e8997328 None None] MFA Rules not processed for user `c00f0422c7904745ac47fd33b8dd3eea`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:47.309394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab2f08ce-7c17-4cca-b354-ed66e8997328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:47.481941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 808/1627] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:47.496865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:47.634903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013e210-6546-488c-841b-b56b7e7cf039 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:47.644200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:47.645495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.645843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.646231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.666651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:47.668297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:47.698191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b7a-b3ed-4acc-9d87-fc94a70b1c71 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.698470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b7a-b3ed-4acc-9d87-fc94a70b1c71 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.698738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b7a-b3ed-4acc-9d87-fc94a70b1c71 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.700541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 809/1628] 10.222.0.30 () {54 vars in 912 bytes} [Sun Aug 7 18:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:19:47.707434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:47.707715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:47.707981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:47.717050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 820/1629] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:47.749001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:47.757881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:47.969033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 810/1630] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:19:47.992183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:48.011124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15862ad9-1c82-4650-814f-0d66b2e68849 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:48.015590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:48.016207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:48.016495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:48.017092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:48.044864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:48.048598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e7ba-6a35-418e-97ca-f350d0b1f41a service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:48.084779 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 821/1631] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:49.310375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:49.399613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:49.417632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0439-b34f-4703-bf03-fc88354be361 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:49.451700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:49.454051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.454415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.455918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] PATH_INFO: `/v3/users/c5e4c29a035f4e618bec79205cc3febe` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.461459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e4c29a035f4e618bec79205cc3febe)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:49.462551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:19:49.462551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 07 18:19:49.462551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: Aug 07 18:19:49.463858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:49.665438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa1ef-1765-4e13-b387-12171a3c5afe None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.666835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa1ef-1765-4e13-b387-12171a3c5afe None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.667320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa1ef-1765-4e13-b387-12171a3c5afe None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.669881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 822/1632] 10.222.0.30 () {54 vars in 962 bytes} [Sun Aug 7 18:19:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:19:49.680985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a587-334a-4ddc-b3d7-5fa4d94ce136 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.682720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a587-334a-4ddc-b3d7-5fa4d94ce136 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.683563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69a587-334a-4ddc-b3d7-5fa4d94ce136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.700603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e4c29a035f4e618bec79205cc3febe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:49.728047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e4c29a035f4e618bec79205cc3febe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:49.739824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5f69a587-334a-4ddc-b3d7-5fa4d94ce136 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:49.743548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5f69a587-334a-4ddc-b3d7-5fa4d94ce136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:49.773226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 823/1633] 10.222.0.30 () {58 vars in 1059 bytes} [Sun Aug 7 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:49.776667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e4c29a035f4e618bec79205cc3febe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:49.778517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e4c29a035f4e618bec79205cc3febe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:49.780520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962297c-f53d-42fc-9b84-cca3b5e2bfa6 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.781056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962297c-f53d-42fc-9b84-cca3b5e2bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.781610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962297c-f53d-42fc-9b84-cca3b5e2bfa6 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.783699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dd3dbf93-4154-49c2-9fe2-421334adafca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e4c29a035f4e618bec79205cc3febe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:49.784239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 824/1634] 10.222.0.30 () {54 vars in 912 bytes} [Sun Aug 7 18:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:19:49.793285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.793757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.794158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.850122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 811/1635] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:19:49 2022] DELETE /identity/v3/users/c5e4c29a035f4e618bec79205cc3febe => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:49.853624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:49.857853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:49.858391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:49.866259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:49.868152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:49.908257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:49.910091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:49.990384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:50.095313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 825/1636] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:50.097854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:50.101400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:50.146190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 812/1637] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:50.183590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:50.186248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:50.271900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffe33e-b2d5-4bed-94b8-7e904cefbb24 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:50.299307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:50.300476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:50.301624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:50.302156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:50.322179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:50.323876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598d8de-fc39-4350-8ebe-28f7063aa080 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:50.358899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b90238-0eac-4ba0-b395-3ed51b0e77b8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:50.362198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 826/1638] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:50.380502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:50.383309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:50.383707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:50.384085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:50.414138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:50.418234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:50.449935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 813/1639] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:50.739405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:50.741156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:50.742282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:50.823839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] MFA Rules not processed for user `c537e185798d46939404523314221295`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:50.830037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:51.082703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 827/1640] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:51.089641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.089641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:51.130946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f9ad1-369f-4978-99cd-ad9bef218410 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.137885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.138585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.138868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.139144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.139777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.143805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.186455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:51.232160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 814/1641] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:51 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:51.236085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.252816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7f70-6b60-4580-9187-515d880619a2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.336613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.337305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.337583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.337848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.338555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.341547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.377731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 828/1642] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:51 2022] POST /identity/v3/users => generated 308 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:51.383259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.408669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bbb09-b80a-48ba-a7c6-7b87938c5ca3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.415976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.417084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.417439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.417789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.418579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.420367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.439054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 815/1643] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:19:51.440511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.459554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76134-47f6-402e-9d3f-a3f51cae1e38 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.466202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.467841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.468401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.468867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] PATH_INFO: `/v3/projects/4167920efb3a4a7e9e13f97709a5cab4/users/b38c01437c9646e8820f67168ce75eb9/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.492264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:51.504127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4167920efb3a4a7e9e13f97709a5cab4, user_id=b38c01437c9646e8820f67168ce75eb9, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.507883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.537386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 829/1644] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:51 2022] PUT /identity/v3/projects/4167920efb3a4a7e9e13f97709a5cab4/users/b38c01437c9646e8820f67168ce75eb9/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:51.539389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.554307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ea21-c49e-4fd7-a301-e47a1c3fea68 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.670357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.671858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.672136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.672404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.673767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.676350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.691892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 816/1645] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:51.696476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.715583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663ecf9-9593-42ae-bc30-db9772c1e0de admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:51.723127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:51.724014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:51.724399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:51.724782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] PATH_INFO: `/v3/projects/4167920efb3a4a7e9e13f97709a5cab4/users/b38c01437c9646e8820f67168ce75eb9/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:51.730767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4167920efb3a4a7e9e13f97709a5cab4, user_id=b38c01437c9646e8820f67168ce75eb9, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:51.734797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:51.759167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 830/1646] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:51 2022] PUT /identity/v3/projects/4167920efb3a4a7e9e13f97709a5cab4/users/b38c01437c9646e8820f67168ce75eb9/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:19:51.930892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:51.933576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:51.948961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c0754-ecc2-4ef4-9d92-ee20e404dc4d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:52.074790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:52.076116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:52.077085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:52.077566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] PATH_INFO: `/v3/projects/4c1d1a259a3147559534e98a7124d5a3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:52.081048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1d1a259a3147559534e98a7124d5a3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:52.081048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:52.209087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1d1a259a3147559534e98a7124d5a3', 'request_id': 'req-05b77669-8c16-40f2-9a8e-83638752769f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.229722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1d1a259a3147559534e98a7124d5a3', 'request_id': 'req-05b77669-8c16-40f2-9a8e-83638752769f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.260601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1d1a259a3147559534e98a7124d5a3', 'request_id': 'req-05b77669-8c16-40f2-9a8e-83638752769f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.297746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] The token cache is being invalidate because project 4c1d1a259a3147559534e98a7124d5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:19:52.298180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.299041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05b77669-8c16-40f2-9a8e-83638752769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.305737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:52.306471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 817/1647] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:19:51 2022] DELETE /identity/v3/projects/4c1d1a259a3147559534e98a7124d5a3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:19:52.307599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:52.330583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4fbdf-0f09-43b7-bbb8-dc5558203d37 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:52.452789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:52.455595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:52.456091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:52.456552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] PATH_INFO: `/v3/users/c00f0422c7904745ac47fd33b8dd3eea` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:52.458252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00f0422c7904745ac47fd33b8dd3eea)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:52.462116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:52.548059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:52.549161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:52.549698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:52.574956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:52.578052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00f0422c7904745ac47fd33b8dd3eea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.605106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00f0422c7904745ac47fd33b8dd3eea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.606995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] MFA Rules not processed for user `7bd39d1cce924d77979ded850bbfbea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:52.610881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:52.635384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00f0422c7904745ac47fd33b8dd3eea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.650865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00f0422c7904745ac47fd33b8dd3eea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.651692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00f0422c7904745ac47fd33b8dd3eea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:52.665156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 831/1648] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:19:52 2022] DELETE /identity/v3/users/c00f0422c7904745ac47fd33b8dd3eea => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:19:52.764891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 818/1649] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:52.781937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:52.784495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:52.904972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:52.967690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02f4e0-81e7-44be-9fa2-493e041e29c0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:52.978304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:52.978928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:52.979211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:52.979523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:53.084165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:53.087533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17206ad8-21ed-4a54-a96e-832fadaee688 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:53.126009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 832/1650] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:19:53.655416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:53.657709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:53.679631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf2f3e-352f-4151-99af-2bc9a7ac7780 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:53.777772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:53.781702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:53.782410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:53.782875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] PATH_INFO: `/v3/projects/bce72f2727f04d428722829c10a1f4e6` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:53.786461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce72f2727f04d428722829c10a1f4e6)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:53.788795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:53.867909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce72f2727f04d428722829c10a1f4e6', 'request_id': 'req-cfc9a898-3208-4b72-b336-fd479230176a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:53.879657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce72f2727f04d428722829c10a1f4e6', 'request_id': 'req-cfc9a898-3208-4b72-b336-fd479230176a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:53.894794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce72f2727f04d428722829c10a1f4e6', 'request_id': 'req-cfc9a898-3208-4b72-b336-fd479230176a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:53.937548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] The token cache is being invalidate because project bce72f2727f04d428722829c10a1f4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:19:53.938098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:53.938860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cfc9a898-3208-4b72-b336-fd479230176a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:19:53.940923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 819/1651] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:19:53 2022] DELETE /identity/v3/projects/bce72f2727f04d428722829c10a1f4e6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:19:53.946529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:53.947329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:53.947733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:53.980635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:54.006664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:54.156404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 833/1652] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:54.164973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.165591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.165981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.228088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:54.230970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:54.252783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 820/1653] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:54.257199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.267462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9cc11-ca15-440f-ae7c-15ea58d770d9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.278583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.279575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.280065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.280541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.282357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:19:54.283534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:54.289462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:54.327863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 834/1654] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:19:54.328223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.340576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347e6a-045c-4bc7-88af-06b675e72332 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.347906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.348340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.348621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.348888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.349517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:54.351742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:54.398052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:54.455549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 821/1655] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:19:54 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:54.459825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.477187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd412-962e-47ca-b648-af2265a13500 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.668742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.670233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.670233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.675097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.675981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:54.679088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:54.750989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 835/1656] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:19:54 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:19:54.755062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.771849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7995b-b384-42cb-a3b5-786bca7ccd13 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.792974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.793770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.794410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.794843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.795736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:54.797510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:54.848123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 822/1657] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:54.855494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.908270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ff14-1567-40aa-bb09-f2d05f85cd7a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.921940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.922913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.923192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.923461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:54.924118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:54.925944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b322d3-5c60-4cb5-a936-620298271752 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:54.929766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:19:54.960343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 836/1658] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:19:54.960973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:54.980348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96a6b-3ea6-4d15-a8c9-167a53b17549 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:54.996741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:54.997427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:54.997706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:54.998003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] PATH_INFO: `/v3/projects/93005757c55a4d7aa540827762f6e893/users/519701c8f2a14be9aaa13bf8f8971aec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:55.052051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93005757c55a4d7aa540827762f6e893, user_id=519701c8f2a14be9aaa13bf8f8971aec, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:55.059199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb806436-3446-4e38-8f51-038dc968f53a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:55.084513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 823/1659] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:19:54 2022] PUT /identity/v3/projects/93005757c55a4d7aa540827762f6e893/users/519701c8f2a14be9aaa13bf8f8971aec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:19:55.099968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:55.101157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:55.101468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:55.227838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] MFA Rules not processed for user `519701c8f2a14be9aaa13bf8f8971aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:55.241653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:55.291100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a38d4-a295-4e81-a6ea-0608aab318da None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:55.291383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a38d4-a295-4e81-a6ea-0608aab318da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:55.291897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a38d4-a295-4e81-a6ea-0608aab318da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:55.354690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e61a38d4-a295-4e81-a6ea-0608aab318da None None] MFA Rules not processed for user `b38c01437c9646e8820f67168ce75eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:55.356974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e61a38d4-a295-4e81-a6ea-0608aab318da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:55.461080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 837/1660] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:55.466436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:55.469462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:55.561850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 824/1661] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:19:55.608457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101e3bc-3902-4e63-8dab-e0b053b6d10c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:55.613606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:55.614519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:55.614896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:55.617202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:55.635166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:55.636568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568c9b-c012-4431-b05a-c4c78a0d3930 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:55.682754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 838/1662] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:19:58.452353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500825-a512-4e7d-b391-2e28d5db02b3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.452959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500825-a512-4e7d-b391-2e28d5db02b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.453178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500825-a512-4e7d-b391-2e28d5db02b3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.455053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 825/1663] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:19:58.560787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dd85-ffac-4366-ba6f-1a83eba68e73 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.561309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dd85-ffac-4366-ba6f-1a83eba68e73 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.561309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dd85-ffac-4366-ba6f-1a83eba68e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.686266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-32b7dd85-ffac-4366-ba6f-1a83eba68e73 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:58.695278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-32b7dd85-ffac-4366-ba6f-1a83eba68e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:58.719554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f0f7-979f-42e7-bd25-15158576005a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:58.720027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f0f7-979f-42e7-bd25-15158576005a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:58.720476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94f0f7-979f-42e7-bd25-15158576005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:58.759549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1f94f0f7-979f-42e7-bd25-15158576005a None None] MFA Rules not processed for user `7bd39d1cce924d77979ded850bbfbea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:58.764615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1f94f0f7-979f-42e7-bd25-15158576005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:59.007433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 839/1664] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:19:59.026935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 826/1665] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:59.122628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0feb1-442d-4272-b59b-cdc2ebcac559 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.122915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0feb1-442d-4272-b59b-cdc2ebcac559 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.123189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0feb1-442d-4272-b59b-cdc2ebcac559 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.124833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 840/1666] 10.222.0.30 () {54 vars in 961 bytes} [Sun Aug 7 18:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:19:59.134608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb12037-2c41-453f-8a17-2b372f482a48 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.134922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb12037-2c41-453f-8a17-2b372f482a48 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.135204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb12037-2c41-453f-8a17-2b372f482a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.201008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-acb12037-2c41-453f-8a17-2b372f482a48 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:19:59.207242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-acb12037-2c41-453f-8a17-2b372f482a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:19:59.237063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 827/1667] 10.222.0.30 () {58 vars in 1058 bytes} [Sun Aug 7 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:19:59.246668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0feb1-442d-4272-b59b-cdc2ebcac559 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:19:59.275743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0feb1-442d-4272-b59b-cdc2ebcac559 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:19:59.294243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:19:59.294647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:19:59.294940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:19:59.295189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:19:59.330437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:19:59.335313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc85a82-af4d-4dfb-9b1b-1bb08685f28f service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:19:59.361619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 841/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:00.935488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088efc1-7ddc-407b-8bf7-1d9eb5cb2aed None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.936026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088efc1-7ddc-407b-8bf7-1d9eb5cb2aed None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.936108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088efc1-7ddc-407b-8bf7-1d9eb5cb2aed None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:00.937697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 828/1669] 10.222.0.30 () {54 vars in 912 bytes} [Sun Aug 7 18:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:00.952927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf57a-7ba1-430c-8ec9-43e1ca41d595 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:00.953852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf57a-7ba1-430c-8ec9-43e1ca41d595 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:00.954895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaf57a-7ba1-430c-8ec9-43e1ca41d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.000963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:01.051600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a8eaf57a-7ba1-430c-8ec9-43e1ca41d595 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:01.054184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a8eaf57a-7ba1-430c-8ec9-43e1ca41d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.198816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 842/1670] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:01.527685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.528013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.528306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.529684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 829/1671] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:20:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:01.557141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.557808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.558325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.586842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.592961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.596859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] MFA Rules not processed for user `cbcc51e7684049648ca969b9f7c97c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:01.598454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.622537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 843/1672] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:01.638993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.657699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06642-68d1-40e0-8e28-7defa97ac397 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.661394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98def5-b07e-4d26-882d-3a418212befe None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.676110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.676752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.677034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.677310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.679288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.680052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.680437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.681053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.702202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.708463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.709810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.714672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:01.734823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 844/1673] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:01.735763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:01.737550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:01.740236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 830/1674] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:01.900011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9346-4e1a-46a4-be97-e29ed0009827 service placement] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:01.913519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:01.914218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:01.914495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:01.914759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] PATH_INFO: `/v3/users/c537e185798d46939404523314221295` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:01.927833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c537e185798d46939404523314221295)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:01.930414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:02.073869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c537e185798d46939404523314221295'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:02.095978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c537e185798d46939404523314221295'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:02.142156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c537e185798d46939404523314221295'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:02.163364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c537e185798d46939404523314221295'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:02.164162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-196ecb6d-c6fb-4a5c-823b-0aaf160584fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c537e185798d46939404523314221295'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:02.178184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 845/1675] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:01 2022] DELETE /identity/v3/users/c537e185798d46939404523314221295 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:03.061618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.082525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0b78-5caf-4a4e-b42e-4507a73247af service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.159741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:03.251083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.251772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.252144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.253149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] PATH_INFO: `/v3/projects/b40cec6f8b4d4e06a0a4b1f4b6693589` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.255693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40cec6f8b4d4e06a0a4b1f4b6693589)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.259146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.319499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9495df-2277-4b15-a8f2-56a25afc7156 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.320032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9495df-2277-4b15-a8f2-56a25afc7156 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.320032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9495df-2277-4b15-a8f2-56a25afc7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.360740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:03.429965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5e9495df-2277-4b15-a8f2-56a25afc7156 None None] MFA Rules not processed for user `e002e42dfdf446b49fd421f55c8cee25`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:03.434669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5e9495df-2277-4b15-a8f2-56a25afc7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.521206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40cec6f8b4d4e06a0a4b1f4b6693589', 'request_id': 'req-f4135a6e-e52f-4b51-879d-176464446c6e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:03.531704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40cec6f8b4d4e06a0a4b1f4b6693589', 'request_id': 'req-f4135a6e-e52f-4b51-879d-176464446c6e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:03.562078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40cec6f8b4d4e06a0a4b1f4b6693589', 'request_id': 'req-f4135a6e-e52f-4b51-879d-176464446c6e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:03.598110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] The token cache is being invalidate because project b40cec6f8b4d4e06a0a4b1f4b6693589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:03.598610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:03.600901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:03.606805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 831/1676] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:03 2022] DELETE /identity/v3/projects/b40cec6f8b4d4e06a0a4b1f4b6693589 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:03.607868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.612812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 846/1677] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:03.613358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.614212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.614499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.614946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.677995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] MFA Rules not processed for user `c2d6b067b6c24b53957ef39d3d00242b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:03.679286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.739808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135a6e-e52f-4b51-879d-176464446c6e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.748054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.748693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.748959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.749306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.752787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.778500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 847/1678] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:03.779479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.782053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.789951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.791828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.803333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 832/1679] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:03.804360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:03.805751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.878952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:03.900142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3197fa-c533-4231-aee0-5ddc78926bfc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.906701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.907416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.907693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.908029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] PATH_INFO: `/v3/users/b38c01437c9646e8820f67168ce75eb9` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.909305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38c01437c9646e8820f67168ce75eb9)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:03.911410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:03.931085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4da53-168c-4088-b52e-2336e3a948a2 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:03.947341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:03.948121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:03.948499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:03.948866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:03.952157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:03.977438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:04.007267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38c01437c9646e8820f67168ce75eb9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:04.031341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38c01437c9646e8820f67168ce75eb9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:04.067935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:04.068759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38c01437c9646e8820f67168ce75eb9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:04.071038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd336fba-4d82-4253-8760-9fe86d5df8bf service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:04.077403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38c01437c9646e8820f67168ce75eb9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:04.078387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-daa3c02f-193c-420e-ae19-bef171244f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38c01437c9646e8820f67168ce75eb9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:04.082530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 833/1680] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:04.084450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cde7e-fa16-4a76-9787-ea54372c58fe None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.085541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cde7e-fa16-4a76-9787-ea54372c58fe None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.086750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cde7e-fa16-4a76-9787-ea54372c58fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.104954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 848/1681] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:03 2022] DELETE /identity/v3/users/b38c01437c9646e8820f67168ce75eb9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:04.106389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.106672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.106941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.144837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7f5cde7e-fa16-4a76-9787-ea54372c58fe None None] MFA Rules not processed for user `ac719afc003945c7ab9fa308946b23ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:04.146229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7f5cde7e-fa16-4a76-9787-ea54372c58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.153119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] MFA Rules not processed for user `c2d6b067b6c24b53957ef39d3d00242b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:04.154372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.318438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 834/1682] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:04.318659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 849/1683] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:04.321951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.322411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.323265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.324057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:04.325927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.373173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] MFA Rules not processed for user `ac719afc003945c7ab9fa308946b23ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:04.379445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.402312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 835/1684] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:04.411430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:04.414119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.477269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abcfc6-f92a-43ff-b356-7422f5e4f8a1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:04.484941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:04.486036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.486036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.486372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.489680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.507390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:04.509439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:04.525603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 850/1685] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:04.544957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:04.547358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:04.680542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:04.711545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c76f1-4a4e-4a4a-a985-6ac6174d9775 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:04.723534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:04.724155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.724432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.724698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.746465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbf862-27d6-43d8-8d90-5ecf2787f9a9 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:04.747749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:04.751260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3b66a-8cd3-4ab0-8635-2a2c9697a60f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:04.770746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:04.772691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:04.775817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:04.776186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:04.776395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] PATH_INFO: `/v3/projects/4167920efb3a4a7e9e13f97709a5cab4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:04.780618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4167920efb3a4a7e9e13f97709a5cab4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:04.784355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: WARNING py.warnings [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 18:20:04.784355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: warnings.warn(msg) Aug 07 18:20:04.784355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: Aug 07 18:20:04.805054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:04.812804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 836/1686] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:05.025068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4167920efb3a4a7e9e13f97709a5cab4', 'request_id': 'req-9fbea9cf-c813-4d4a-b901-320341f24b13'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.042442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4167920efb3a4a7e9e13f97709a5cab4', 'request_id': 'req-9fbea9cf-c813-4d4a-b901-320341f24b13'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.074632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4167920efb3a4a7e9e13f97709a5cab4', 'request_id': 'req-9fbea9cf-c813-4d4a-b901-320341f24b13'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.111717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] The token cache is being invalidate because project 4167920efb3a4a7e9e13f97709a5cab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:05.112011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.113968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9fbea9cf-c813-4d4a-b901-320341f24b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:05.121820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 851/1687] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:04 2022] DELETE /identity/v3/projects/4167920efb3a4a7e9e13f97709a5cab4 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:05.132697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.133267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.133356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.182874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.184439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.429474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 837/1688] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:05.434333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.434821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.434821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.499020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.503499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.530242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 852/1689] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:05.534406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.559663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4af1-97ca-44f8-8aeb-b5510d5f3942 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.584129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.587223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.587836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.588166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.599178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:05.599498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.602149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:05.665759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 838/1690] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:05.666720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.678938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ecc8-4db1-4157-9cbb-badab049a923 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.694875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.695496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.695767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.696025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.696879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.701865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f7c57-01ce-4df4-a712-6ca3dd26c54e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:05.773383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 853/1691] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:05.780599 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:05.787348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c3ea-f2b1-416a-8549-152b18f28b44 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.788359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c3ea-f2b1-416a-8549-152b18f28b44 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.788640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c3ea-f2b1-416a-8549-152b18f28b44 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.793020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 854/1692] 10.222.0.30 () {54 vars in 912 bytes} [Sun Aug 7 18:20:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 18:20:05.797884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88210b-a090-4e93-bae9-f0162b91527d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:05.808530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.809006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.809417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.860709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:05.861976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:05.962718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:05.963461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:05.963708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:05.964565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:05.964820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:05.970311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.020792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 839/1693] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:06.023176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.041442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034d3c-b0c6-4c87-ad77-78dd3847de3e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.049206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 855/1694] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:06.051909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.052143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.054738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.055031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.057757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.061249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.061600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.062869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:06.083005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3ee35-f668-42a6-9eae-1ac4ba7f6c90 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.086987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.087599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.087872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.088137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.094682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 840/1695] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:06.095738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.112530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.114095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.121230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ceeb7-90e4-4ffd-a74d-aec81447203c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.132817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 856/1696] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:06.135938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.140671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.141038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.141378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.142243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.143879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c33552-c3f6-4bb2-9ab9-bcdef1289cc0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.175376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 841/1697] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:06.178124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.199990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98c70f-4f8a-47a7-9110-a5ce27dc3e6e service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.227786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.228459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.228733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.228998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] PATH_INFO: `/v3/projects/6efaed35f9794ecfa722e1213f782cf7/users/72b31720986a4cef98cb02a897c1f70f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.280230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efaed35f9794ecfa722e1213f782cf7, user_id=72b31720986a4cef98cb02a897c1f70f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.283150 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.313949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 857/1698] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:06 2022] PUT /identity/v3/projects/6efaed35f9794ecfa722e1213f782cf7/users/72b31720986a4cef98cb02a897c1f70f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:06.325776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.326088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.326537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.418050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] MFA Rules not processed for user `72b31720986a4cef98cb02a897c1f70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:06.419598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:06.550347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:06.612992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 842/1699] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:06.617810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.636255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:06.751340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3231-b730-4c6d-b326-8757f05c2015 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:06.778937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:06.779971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:06.780417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:06.780968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:06.782355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:06.789409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:06.853129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 858/1700] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:06 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:06.857526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:06.882857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910e892-d568-4ee5-b5cb-ce9fde6aca1a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.088066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.088954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.089239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.089506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.091000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.092954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.156244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 843/1701] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:06 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:07.164479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.185034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8663ef-45e7-4cc2-a62b-2ab9c8b83a8f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.192146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.192822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.193271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.194302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.194973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.196607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.214168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 859/1702] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:07.217883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.245513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb253fa-0ccc-479f-bb05-8eb1837967c3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.254656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.256563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.257121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.257677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] PATH_INFO: `/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde/users/235bba24cf794b1684246c2a2e3f23c3/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.276826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bf2d6fcb744afaa1b0ab74ab4f3fde, user_id=235bba24cf794b1684246c2a2e3f23c3, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.281371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.312280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 844/1703] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:07 2022] PUT /identity/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde/users/235bba24cf794b1684246c2a2e3f23c3/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:07.316281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.338980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4a033-64f6-4121-b82f-cd249e70005e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.513389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.515511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:07.588636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.593573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.593855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.596644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.600755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.608149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.655313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 860/1704] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:07.667442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:07.727341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed4dc-ed64-43cd-88f3-df04d84f14bc admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.758894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.760132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.762283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.764082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] PATH_INFO: `/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde/users/235bba24cf794b1684246c2a2e3f23c3/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.774344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bf2d6fcb744afaa1b0ab74ab4f3fde, user_id=235bba24cf794b1684246c2a2e3f23c3, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.784835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ddd3-ea48-4d80-b4d0-ff231e8920f8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.804583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdfaa9-7a5e-4dc6-84e7-2a94a76b44c6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:07.821644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:07.822499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.822789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.823061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] PATH_INFO: `/v3/users/5fa9ee4262b1424e8ef96517c4c2df21` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.828974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa9ee4262b1424e8ef96517c4c2df21)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:07.844091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 861/1705] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:07 2022] PUT /identity/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde/users/235bba24cf794b1684246c2a2e3f23c3/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:07.846496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a990-1681-407d-bc0c-b0cfa2578e99 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:07.847511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:07.851227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a990-1681-407d-bc0c-b0cfa2578e99 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:07.853173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a990-1681-407d-bc0c-b0cfa2578e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:07.972401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa9ee4262b1424e8ef96517c4c2df21'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:07.997395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.018729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa9ee4262b1424e8ef96517c4c2df21'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.049195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa9ee4262b1424e8ef96517c4c2df21'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.050114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa9ee4262b1424e8ef96517c4c2df21'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.051234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa9ee4262b1424e8ef96517c4c2df21'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.076914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1156a990-1681-407d-bc0c-b0cfa2578e99 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.079946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 845/1706] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:07 2022] DELETE /identity/v3/users/5fa9ee4262b1424e8ef96517c4c2df21 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:08.080068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1156a990-1681-407d-bc0c-b0cfa2578e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.080167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.080714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.175143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.228644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ab0d-ffcd-4d60-a191-f1f649b9bbac admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:08.234601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:08.235358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.235635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.236076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] PATH_INFO: `/v3/users/44c4934c09544508aed2a43f9143d105` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.237597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c4934c09544508aed2a43f9143d105)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:08.239982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:08.244121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 862/1707] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.246307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87affa4-79b4-4af5-9659-7601cb18e7fd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.246899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87affa4-79b4-4af5-9659-7601cb18e7fd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.247357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87affa4-79b4-4af5-9659-7601cb18e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.301570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d87affa4-79b4-4af5-9659-7601cb18e7fd None None] MFA Rules not processed for user `235bba24cf794b1684246c2a2e3f23c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.311446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d87affa4-79b4-4af5-9659-7601cb18e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.391282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c4934c09544508aed2a43f9143d105'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.416134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c4934c09544508aed2a43f9143d105'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.455187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c4934c09544508aed2a43f9143d105'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.456485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 863/1708] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.459100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c4934c09544508aed2a43f9143d105'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.465010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1ab6ef71-3bb5-415e-aafb-2c3cf4d07554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c4934c09544508aed2a43f9143d105'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:08.466438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.466737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.467021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.506754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] MFA Rules not processed for user `c2d6b067b6c24b53957ef39d3d00242b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.507477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.522665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 846/1709] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:08 2022] DELETE /identity/v3/users/44c4934c09544508aed2a43f9143d105 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:08.529059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.529342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.534539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.597638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:08.599660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.627470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 864/1710] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.633259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.635089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.750139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.781526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819bac-ca99-4231-b713-1e03e9807111 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:08.787556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 847/1711] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:08.788797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:08.792308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:08.834218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:08.947688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:08.948489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:08.948870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:08.949253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:08.954340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.083011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2a3f-64e5-4d1e-a429-1251d154d256 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.091438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.092411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.092933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.093346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.095934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.153459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.155993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd22a75-577c-4fef-8e4a-a283481e0d2f service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.186550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 865/1712] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:09.188981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.189534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.190073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.233436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:09.234711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.256894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 866/1713] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:09.257821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.261602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.266248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.268113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.310537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 848/1714] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:20:09.312131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.314467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.388825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004edbd-9ef1-431c-99dd-e993c873c23c service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.401969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.402685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.402939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.403212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] PATH_INFO: `/v3/users/519701c8f2a14be9aaa13bf8f8971aec` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.406636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=519701c8f2a14be9aaa13bf8f8971aec)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.408591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.453882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c497c1-5287-4d5c-933c-426a67d43a48 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.465281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.467611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.468307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.469745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.501539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.508016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.538219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 867/1715] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:09.539327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.561747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3c469-15f4-46b0-a4a2-da021dbd3fa1 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.570086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519701c8f2a14be9aaa13bf8f8971aec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.573141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.575975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.577173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.577884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.590297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519701c8f2a14be9aaa13bf8f8971aec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.612051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:09.616836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:09.618643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:09.624027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519701c8f2a14be9aaa13bf8f8971aec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.630665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519701c8f2a14be9aaa13bf8f8971aec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.633273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3308afec-a208-48c5-891c-1c71b74bf0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519701c8f2a14be9aaa13bf8f8971aec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:09.658171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 868/1716] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:09.664321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 849/1717] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:09 2022] DELETE /identity/v3/users/519701c8f2a14be9aaa13bf8f8971aec => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:09.668276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:09.669508 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.670604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.670972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.702648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfdacb-bf14-446c-8cb1-d508a9836668 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:09.712734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:09.721525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:09.942021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:09.942657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:09.948250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:09.950698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:09.954329 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.029069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:10.029946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 850/1718] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:10.120812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:10.125679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:10.225621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.227126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c012e-bfd7-4f5a-a984-ae00a354f021 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:10.253784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 869/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:10.290520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c3ec-e18d-464d-b32b-025b647d8db3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:10.297409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:10.298081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:10.298358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:10.298628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:10.322649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:10.324530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:10.339271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 851/1720] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:11.233166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.233742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.233742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.307589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.308870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.332484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 870/1721] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:11.441397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.442925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.461097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a739f-e960-4867-883a-0f8411a4606c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.471082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.471842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.471991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.473645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.479881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:11.481541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.520835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:11.524432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d620711-a2fc-4713-ac76-b77b758471c2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:11.525475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b63d-c3c5-4dc4-a7dc-b3e20006f255 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.544985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:11.544985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.544985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.544985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] PATH_INFO: `/v3/projects/fd5aca063bbd4b09a600c9ded1d13b7d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.549292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5aca063bbd4b09a600c9ded1d13b7d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:11.551833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:11.552532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 852/1722] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:11.554553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605ea-d805-4293-a4cb-64ade647582b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.558506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605ea-d805-4293-a4cb-64ade647582b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.560030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a605ea-d805-4293-a4cb-64ade647582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.644141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c7a605ea-d805-4293-a4cb-64ade647582b None None] MFA Rules not processed for user `e002e42dfdf446b49fd421f55c8cee25`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.657495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c7a605ea-d805-4293-a4cb-64ade647582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:11.777446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5aca063bbd4b09a600c9ded1d13b7d', 'request_id': 'req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.808327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5aca063bbd4b09a600c9ded1d13b7d', 'request_id': 'req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.831129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5aca063bbd4b09a600c9ded1d13b7d', 'request_id': 'req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.911731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] The token cache is being invalidate because project fd5aca063bbd4b09a600c9ded1d13b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:11.915947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.916936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5f9c9eb6-62ea-4228-81f6-daab38dc6edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:11.926840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 871/1723] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:11 2022] DELETE /identity/v3/projects/fd5aca063bbd4b09a600c9ded1d13b7d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:11.929313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:11.929609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 853/1724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:11.931988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:11.933660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:11.984407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:11.985860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.316500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 872/1725] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:12.323169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.323455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.323730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.381657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:12.383186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:12.410487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 854/1726] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:12.414923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.429521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eed266-6bbc-446b-9293-75edefd03467 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.452724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.453414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.453801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.454209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.455342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:12.455782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.465442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.515101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 873/1727] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:12.516050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.537258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e28aa-b2a4-4e33-923c-99bb12746de2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.555603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.556586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.557119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.558258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.559230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.568578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.595147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:12.654277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 855/1728] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:12.658781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.704112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b891e1-f064-4d89-be8f-9bfd2176c0f1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:12.761268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:12.872678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:12.873612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:12.874327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:12.874785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:12.875441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:12.878305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:12.971145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:12.972017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 874/1729] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:12 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:12.999061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167a5eb-d7e8-4466-88ea-d57171c7048e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.011421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.012093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.012361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.012863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.013535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.015924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.106670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 856/1730] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:13.110747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.135496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391aff7-12e9-43ed-b991-03dba64ce7b5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.146358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.147518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.148350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.148868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.151524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.155375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a8e3-4356-4fdf-84e9-7f20cea38db8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.226137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 875/1731] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:13.230260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.271308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc64ea-ebf2-41c9-ab85-f9630c46e152 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:13.318841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:13.319539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.320927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.321758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] PATH_INFO: `/v3/projects/d195011d24f44822a101d62ebfca432d/users/32f4e1f92a7d4a8a8d84d9f52e486bc1/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.392670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d195011d24f44822a101d62ebfca432d, user_id=32f4e1f92a7d4a8a8d84d9f52e486bc1, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:13.404140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:13.456140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 857/1732] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:13 2022] PUT /identity/v3/projects/d195011d24f44822a101d62ebfca432d/users/32f4e1f92a7d4a8a8d84d9f52e486bc1/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:13.458181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:13.459405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:13.459907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:13.545356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] MFA Rules not processed for user `32f4e1f92a7d4a8a8d84d9f52e486bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:13.551155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:13.816818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.819651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 876/1733] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:13.830585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:13.835525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.009346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4362-67f0-4d8d-b492-07e6524a60ed admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.023449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.024581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.025083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.025555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.026583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.030763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.038803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e5c9a-7e4e-4003-a89b-570b85daad11 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.070343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.071274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.071649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.072033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] PATH_INFO: `/v3/projects/8f969970eb4b4ae685217c1daafea598` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.075374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f969970eb4b4ae685217c1daafea598)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.077451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.115966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 858/1734] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:14.120129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.166457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:14.210518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f969970eb4b4ae685217c1daafea598', 'request_id': 'req-9d737eaf-9fb5-4894-8a7a-9f8980550824'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:14.228130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f969970eb4b4ae685217c1daafea598', 'request_id': 'req-9d737eaf-9fb5-4894-8a7a-9f8980550824'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:14.248570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f969970eb4b4ae685217c1daafea598', 'request_id': 'req-9d737eaf-9fb5-4894-8a7a-9f8980550824'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:14.277666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] The token cache is being invalidate because project 8f969970eb4b4ae685217c1daafea598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:14.279968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:14.280758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9d737eaf-9fb5-4894-8a7a-9f8980550824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:14.288139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 877/1735] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:13 2022] DELETE /identity/v3/projects/8f969970eb4b4ae685217c1daafea598 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:14.291343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9544c-ae99-4150-a94c-d9ee0c43aee3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.291637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9544c-ae99-4150-a94c-d9ee0c43aee3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.293260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9544c-ae99-4150-a94c-d9ee0c43aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.298378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390003-3925-4d3f-a449-d7ec9d8b8c3c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.396645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ceb9544c-ae99-4150-a94c-d9ee0c43aee3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:14.401521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ceb9544c-ae99-4150-a94c-d9ee0c43aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.507031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:14.552754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.553662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.554179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.554689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.555632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.558551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.610814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 878/1736] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:14.621602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.623922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 859/1737] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/users => generated 293 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:14.625466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.627977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.628972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.631264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.675534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12957-0c75-4386-8718-12a99d8b99b5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.690515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.691350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.693380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.695300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.696157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.699383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:14.699776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.700622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:14.722580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 860/1738] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:14.725279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.729836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 879/1739] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:14.732214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.746284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d621170-f390-40e6-8ed8-f1db0482925b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.764499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.765158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.765447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.765749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.766507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:14.766820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.768490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.789523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b659c-8d9c-4dc0-b401-3734c315f659 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.806750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.807806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.808158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.810460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.811368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.821168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.840275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 880/1740] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:14.842875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.862261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1c366-8ba5-4afa-b7b8-c1608e83c694 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.865073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 861/1741] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:14.877853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.878576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.878852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.879116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.879738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.882617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:14.884149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.933049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42736-a6e1-42a4-ace2-7760fcba6725 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:14.942195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:14.944524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:14.945088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:14.945395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] PATH_INFO: `/v3/projects/b5310a6b91c0489ab3d55ff5e5409412/users/bb3187713aa0498796e866023e49fa4e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:14.957279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 881/1742] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:14.966825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5310a6b91c0489ab3d55ff5e5409412, user_id=bb3187713aa0498796e866023e49fa4e, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:14.969499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd14d4-f625-4bf5-aa04-939fef36e937 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:14.971117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.004029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 862/1743] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:14 2022] PUT /identity/v3/projects/b5310a6b91c0489ab3d55ff5e5409412/users/bb3187713aa0498796e866023e49fa4e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:15.015067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.015564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.016209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.120751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] MFA Rules not processed for user `bb3187713aa0498796e866023e49fa4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:15.123030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.149871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea12bfe-95f2-47d8-95b5-8cb8857f61f7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.184695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:15.298407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.299492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.301004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.301277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.303295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.309239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.320085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 863/1744] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:15.320858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.356069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6ce67-1ad3-4595-a94b-07582e7a4925 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.378363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 882/1745] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:14 2022] POST /identity/v3/users => generated 290 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:15.382043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.399225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.399827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.401148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.401422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.402308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.404250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.422754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cf6ef-d04d-403b-b7ee-691a50bf0925 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.435103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.435775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.436028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.436351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.436903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.440961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.473485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 864/1746] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:15.474837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 883/1747] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:15.479381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.480017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.500511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ad50-3d90-4a22-b247-01bfb1e84a7c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.621203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:15.635342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c64c02-d635-4910-aa25-4fd9d0bc413f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.648343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.649352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.649992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.650267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.650530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.651155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.652046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.652319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.652581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.653222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.654853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.657669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.684751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 884/1748] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:15.685716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.688480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:15.705607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1fd99-5a90-4cce-9b81-b92890f7c036 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.717782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.719142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.719429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.719704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] PATH_INFO: `/v3/projects/93005757c55a4d7aa540827762f6e893` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.720876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93005757c55a4d7aa540827762f6e893)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.723161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.738117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 865/1749] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:15 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:15.739165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.775503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a269ed-a7a0-4c19-92ba-7771f2521e5c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:15.791094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:15.791840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.792254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.792603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] PATH_INFO: `/v3/projects/9142a46542fe4800b524dc8778d033cc/users/4a66b9b0aa2c4494ba581a75d742392e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:15.863550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9142a46542fe4800b524dc8778d033cc, user_id=4a66b9b0aa2c4494ba581a75d742392e, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:15.866473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:15.879420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93005757c55a4d7aa540827762f6e893', 'request_id': 'req-02e892db-8182-4150-aa95-71a97872c332'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.900200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 866/1750] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:15 2022] PUT /identity/v3/projects/9142a46542fe4800b524dc8778d033cc/users/4a66b9b0aa2c4494ba581a75d742392e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:15.901114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:15.915053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93005757c55a4d7aa540827762f6e893', 'request_id': 'req-02e892db-8182-4150-aa95-71a97872c332'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.938621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93005757c55a4d7aa540827762f6e893', 'request_id': 'req-02e892db-8182-4150-aa95-71a97872c332'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.956277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] The token cache is being invalidate because project 93005757c55a4d7aa540827762f6e893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:15.956911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.958121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-02e892db-8182-4150-aa95-71a97872c332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:15.960143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 885/1751] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:15 2022] DELETE /identity/v3/projects/93005757c55a4d7aa540827762f6e893 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:15.961819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:15.962393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:15.963055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.020509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] MFA Rules not processed for user `4a66b9b0aa2c4494ba581a75d742392e`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.024197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.038173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:16.097383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4468dc-0c45-4986-973e-773ee69d6c04 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.108406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.109030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.109298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.109564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.110267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.111845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5dc2e-77f4-4e52-b6b3-cdc68b5277a1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.143055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 867/1752] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:16.144822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.145102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.146835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.214378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 886/1753] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:16.215377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.217445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.218618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.219891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.245759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 868/1754] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:16.245759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.245759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.254909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c80a-1fd4-461a-917d-96a7eb1790dc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.265389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.266218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.266520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.266787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] PATH_INFO: `/v3/projects/193b59cfe3f9497f821532dc9c09cfe7/users/8eec5248430843c5890b5daa9d44ddab/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.273362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67646fc-975f-4a50-bbfc-08f057b40aa9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.287642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.288271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.288544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.288807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.289443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.293767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.301590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193b59cfe3f9497f821532dc9c09cfe7, user_id=8eec5248430843c5890b5daa9d44ddab, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.304549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efc600-f0c2-45b5-8e26-ee68e4c786d9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.342033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 887/1755] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:16 2022] PUT /identity/v3/projects/193b59cfe3f9497f821532dc9c09cfe7/users/8eec5248430843c5890b5daa9d44ddab/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:16.344582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.344914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.345316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.360472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 869/1756] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:16.364215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.389824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.392354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.530266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01855f-119a-42b6-b8f2-3a1a3717f864 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.541471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 888/1757] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:16.542962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.543450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.543593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.543905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.544130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.545151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.546795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.556357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcaa35-6fe1-492b-a8a0-cb69ca89dd92 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.562408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.563671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.564108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.564521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.565299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.567617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.572084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 870/1758] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:16.573567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.595721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c579b5-92c5-40a5-b2b8-6d4a9642aedc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.601009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 889/1759] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/users => generated 296 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:16.602004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.605031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.606293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.606810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.607291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.608305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:16.608859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.611337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.623717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6767d7f-a963-41ca-bef4-196652444f51 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.634239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.636194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.636778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.637308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] PATH_INFO: `/v3/projects/193b59cfe3f9497f821532dc9c09cfe7/users/8eec5248430843c5890b5daa9d44ddab/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.640033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193b59cfe3f9497f821532dc9c09cfe7, user_id=8eec5248430843c5890b5daa9d44ddab, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.648013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2a71-8b66-4845-ba69-44849adaf892 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.652764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 871/1760] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:16.655147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.664584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 890/1761] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:16 2022] PUT /identity/v3/projects/193b59cfe3f9497f821532dc9c09cfe7/users/8eec5248430843c5890b5daa9d44ddab/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:16.667390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a355-830a-4780-9803-2e4f63cb0089 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.667893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a355-830a-4780-9803-2e4f63cb0089 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.669192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81a355-830a-4780-9803-2e4f63cb0089 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.671939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 891/1762] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:20:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:16.672949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81a355-830a-4780-9803-2e4f63cb0089 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:16.675916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485fef-4f64-485e-9850-c7216c61d109 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.689204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:16.800920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:16.808015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.808769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.809613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.813382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.814226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.816272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcdc83-8f1a-4fe8-8a93-c16cfa66cd1f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.827263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81a355-830a-4780-9803-2e4f63cb0089 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:16.831997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 872/1763] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:16.833620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.834604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.835159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.843326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:16.844784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.845210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.845792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.846701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:16.850160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b407e-a9d1-449b-9652-d00e2624fab4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:16.878051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] MFA Rules not processed for user `8eec5248430843c5890b5daa9d44ddab`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.879475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:16.894252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 892/1764] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:16.896088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:16.897068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:16.897418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:16.928804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:16.930235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.020686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 873/1765] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:17.025464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.037734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f1e2e-cf39-4d50-a50d-ce2dfbcad0ac None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.058866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 893/1766] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:17.059854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.142805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.143529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.143809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.144105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] PATH_INFO: `/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb/users/73ff6235808247cca3644f43387288b6/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.153298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ba08d-95a3-4344-852c-9ed36bbe6261 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.158415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.159027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.159301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.159567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.160195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.162625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec2781b3b0b42c28aa98efbec87aeeb, user_id=73ff6235808247cca3644f43387288b6, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.162843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.165330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.181832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 874/1767] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:17 2022] PUT /identity/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb/users/73ff6235808247cca3644f43387288b6/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:17.182707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.185253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 894/1768] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:17 2022] POST /identity/v3/users => generated 281 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:17.185593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.186204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.187787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.204038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333a43d-622e-43a5-b9f1-aa583cb104d7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.206323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:17.246900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424e9d-cd3f-4482-ae33-06a7ac6e6039 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.250829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.251530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.251809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.252099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.260221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:17.274450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.275048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.275323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.275592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.284689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.286316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.296984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 895/1769] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:17.297795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.320075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.321536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.333351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 875/1770] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:17.334790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.385473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b06817-0709-461f-adb7-1d28c81da18f service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.391516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.392253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.392626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.393000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.393750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.395957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.408541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 896/1771] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:17.410360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14835df-50b0-46b4-9a35-5215608b48c4 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.414300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.415896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.416506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.416791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.417241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.417924 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.419585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.431160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdd667-fd6c-4e86-b3a5-a27b54f3b5a1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.440914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.441212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 876/1772] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:17.441300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.441389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.441470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.441470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] PATH_INFO: `/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb/users/73ff6235808247cca3644f43387288b6/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.444323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec2781b3b0b42c28aa98efbec87aeeb, user_id=73ff6235808247cca3644f43387288b6, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.448382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba04f-90ea-44c4-a1b3-9cedca8a2abc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.453251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b64af5-ea1c-4a06-8974-58559272b657 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.463422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.464069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.464351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.464622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.465316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.466974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.470496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 897/1773] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:17 2022] PUT /identity/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb/users/73ff6235808247cca3644f43387288b6/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:17.476670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2173-e4d3-4397-a3cc-ac0a4d2ca041 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.476960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2173-e4d3-4397-a3cc-ac0a4d2ca041 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.477233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c2173-e4d3-4397-a3cc-ac0a4d2ca041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.492327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 877/1774] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:17.495311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.521031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0d9c2173-e4d3-4397-a3cc-ac0a4d2ca041 None None] MFA Rules not processed for user `73ff6235808247cca3644f43387288b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:17.523197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0d9c2173-e4d3-4397-a3cc-ac0a4d2ca041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.523316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c91ea8-6d1c-4ea8-a0a1-1dba41be3738 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.607810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:17.620063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.620758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.621045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.621562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] PATH_INFO: `/v3/projects/2c1bf4a4d6da498fafd8fb59d1b40aba/users/84c17f3aa536482e966039fdec9ee3f3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.629696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 898/1775] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:17.643260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1bf4a4d6da498fafd8fb59d1b40aba, user_id=84c17f3aa536482e966039fdec9ee3f3, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.646265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.662049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 878/1776] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:17 2022] PUT /identity/v3/projects/2c1bf4a4d6da498fafd8fb59d1b40aba/users/84c17f3aa536482e966039fdec9ee3f3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:17.674167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.674671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.674781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.703250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] MFA Rules not processed for user `84c17f3aa536482e966039fdec9ee3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:17.704445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:17.749424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:17.776956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 899/1777] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:17.820805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.922981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c8be7-a474-49ad-9218-459d8d7e9266 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:17.927073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:17.927831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:17.928204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:17.928590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:17.938487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:17.940120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:17.950176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 879/1778] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:17.967403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.987560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:17.996501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b01a9-d69a-41a5-a64e-445364c568fa service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.000153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.000740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.001014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.001273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.002992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.032034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19c2c2-7970-4ba3-9746-611bf8539905 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.037916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.038632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.038901 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.039160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] PATH_INFO: `/v3/users/84c17f3aa536482e966039fdec9ee3f3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.040363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c17f3aa536482e966039fdec9ee3f3)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.042203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.067153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.069159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb4f4-e63f-4250-9022-7d27e581e832 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.079896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 880/1779] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:18.090316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c17f3aa536482e966039fdec9ee3f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.098801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c17f3aa536482e966039fdec9ee3f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.111539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c17f3aa536482e966039fdec9ee3f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.119036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c17f3aa536482e966039fdec9ee3f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.119690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c17f3aa536482e966039fdec9ee3f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.126865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 900/1780] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:17 2022] DELETE /identity/v3/users/84c17f3aa536482e966039fdec9ee3f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:18.130782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.131278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.131487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.151051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.152315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.222404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 881/1781] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:18.235742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:18.238025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.314437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec73e5-bcfb-4c06-931b-f4c257115257 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.321456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.322579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.323033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.323494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.337749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.339894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354793c-39c4-4a55-a202-ab9a71ddd09f service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.359591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 901/1782] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:18.684451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:18.686113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.699000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfe04b-fdf4-4be2-9cab-d5b0c596a7cc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.706378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.706649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.707082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.707391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] PATH_INFO: `/v3/projects/2c1bf4a4d6da498fafd8fb59d1b40aba` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.708675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1bf4a4d6da498fafd8fb59d1b40aba)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.710794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.723181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:18.760223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1bf4a4d6da498fafd8fb59d1b40aba', 'request_id': 'req-be59ba68-3d45-4a0f-898a-2a1046af16f0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.766198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1bf4a4d6da498fafd8fb59d1b40aba', 'request_id': 'req-be59ba68-3d45-4a0f-898a-2a1046af16f0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.774722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1bf4a4d6da498fafd8fb59d1b40aba', 'request_id': 'req-be59ba68-3d45-4a0f-898a-2a1046af16f0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.785142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] The token cache is being invalidate because project 2c1bf4a4d6da498fafd8fb59d1b40aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:18.785444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.786093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be59ba68-3d45-4a0f-898a-2a1046af16f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:18.788169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 882/1783] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:18 2022] DELETE /identity/v3/projects/2c1bf4a4d6da498fafd8fb59d1b40aba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:18.792970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.793470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.793558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.802152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:18.815335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.816527 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.875313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 902/1784] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:18.882996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.883282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.883580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.903562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:18.904741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:18.913090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 883/1785] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:18.917381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:18.927196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59ca36-f020-402b-b304-6fef762074d0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.932414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.933037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.933309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.933574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.934240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:18.934534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.936169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:18.947561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 903/1786] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:18.951872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:18.961079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9702e0-2608-4c2e-bc4e-568079231747 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:18.966137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:18.966730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:18.967006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:18.967274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:18.967896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:18.969805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.002859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 884/1787] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:18 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:19.004035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.014194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716a84-3035-49af-809b-e6884c9c70e9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.070133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.070737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.071022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.071284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.072377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.073964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.101638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 904/1788] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:19 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:19.102429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.115866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0ff86-a7c6-49b7-a2e0-0a36c18c347e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.120580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.121193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.121470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.121736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.122409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.124007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.135385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 885/1789] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:19.139474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.150162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f39f-4c89-44ad-b4d1-0f0869ec3dd8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.155139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.155788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.156063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.156328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.157256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.158562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdc355-9c04-456c-8d21-e5a73a7c0c41 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.173508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 905/1790] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:19.176959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.187795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb1e4-e69f-4887-a773-779ffd11040e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.192657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.193332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.193628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.193925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] PATH_INFO: `/v3/projects/3850f1ce2ae04895b9e91b33c2f9eb46/users/c1e550f891254d91b3e0375cff938e1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.208375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3850f1ce2ae04895b9e91b33c2f9eb46, user_id=c1e550f891254d91b3e0375cff938e1d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.211870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.226449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 886/1791] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:19 2022] PUT /identity/v3/projects/3850f1ce2ae04895b9e91b33c2f9eb46/users/c1e550f891254d91b3e0375cff938e1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:19.236739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7a4d-eb7f-4584-acca-e16631d1d0e8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.237051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7a4d-eb7f-4584-acca-e16631d1d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.237322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe7a4d-eb7f-4584-acca-e16631d1d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.264279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5bfe7a4d-eb7f-4584-acca-e16631d1d0e8 None None] MFA Rules not processed for user `c1e550f891254d91b3e0375cff938e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:19.265491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5bfe7a4d-eb7f-4584-acca-e16631d1d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:19.332109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:19.336766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 906/1792] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:19.347847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:19.350289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:19.490934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a9e7b-8964-4ce3-9f78-d8efa69b8982 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:19.495801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:19.498658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:19.499206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:19.499689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:19.509761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:19.512702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:19.527437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 887/1793] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:20.720311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:20.720875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:20.720875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:20.762171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:20.763432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:20.962764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 907/1794] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:20:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:20.985747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:20.987545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:21.036210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:21.123917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64872795-fc89-4498-a885-d5a7fe6fd8df service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:21.132420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:21.133080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:21.133337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:21.133607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:21.143225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:21.146219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:21.164556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 888/1795] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:20:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:20:23.822650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:23.825530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.918986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c98aa8-310b-48ae-83ad-5927f94fadc3 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:23.922961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:23.923805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:23.924316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:23.924748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:23.926719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:23.953501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:23.955081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.022279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.023900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9362d1-1dd4-4bad-a15f-885526d2e790 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.043433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 908/1796] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:24.058644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a99e-1624-4d0f-8309-06db6dd716ac service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.063088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.063752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.064027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.064298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] PATH_INFO: `/v3/users/72b31720986a4cef98cb02a897c1f70f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.065435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b31720986a4cef98cb02a897c1f70f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.067371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.116739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b31720986a4cef98cb02a897c1f70f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.125436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b31720986a4cef98cb02a897c1f70f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.137433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b31720986a4cef98cb02a897c1f70f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.138112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b31720986a4cef98cb02a897c1f70f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.138718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b31720986a4cef98cb02a897c1f70f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.151303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 889/1797] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:23 2022] DELETE /identity/v3/users/72b31720986a4cef98cb02a897c1f70f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:24.156023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.156309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.156581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.178284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:24.179441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.241878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:24.252091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 909/1798] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:24.261937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:24.263384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.297808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:24.330494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa1ec-8204-4019-92a0-cb15ff932e3b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.334657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.335265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.335538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.335802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.344788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.346249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.357146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 890/1799] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:24.760640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:24.761833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:24.774483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc913c-38a8-4dea-bd5c-d407cb42ee7a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.779660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.780325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.780598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.780865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] PATH_INFO: `/v3/projects/6efaed35f9794ecfa722e1213f782cf7` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.782483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efaed35f9794ecfa722e1213f782cf7)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.784755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:24.846967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efaed35f9794ecfa722e1213f782cf7', 'request_id': 'req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.856689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efaed35f9794ecfa722e1213f782cf7', 'request_id': 'req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.864603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efaed35f9794ecfa722e1213f782cf7', 'request_id': 'req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.889573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] The token cache is being invalidate because project 6efaed35f9794ecfa722e1213f782cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:24.889941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.890574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:24.892777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 910/1800] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:24 2022] DELETE /identity/v3/projects/6efaed35f9794ecfa722e1213f782cf7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:24.896797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:24.906721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98021-a9c0-4fee-9b74-01b0a4082305 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:24.968327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:24.969005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:24.969138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:24.969386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] PATH_INFO: `/v3/users/235bba24cf794b1684246c2a2e3f23c3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:24.970533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] RBAC: Authorizing `identity:delete_user(user_id=235bba24cf794b1684246c2a2e3f23c3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:24.972489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.033629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235bba24cf794b1684246c2a2e3f23c3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.042305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235bba24cf794b1684246c2a2e3f23c3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.057189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235bba24cf794b1684246c2a2e3f23c3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.057925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235bba24cf794b1684246c2a2e3f23c3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.058652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c18d6bb8-1312-4797-8432-05925612783a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235bba24cf794b1684246c2a2e3f23c3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.072189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 891/1801] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:24 2022] DELETE /identity/v3/users/235bba24cf794b1684246c2a2e3f23c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:25.374450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.376033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:25.396026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ef983-43fa-4ca6-8dfb-806c3e6feae9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.468815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.469446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.469721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.470080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] PATH_INFO: `/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.471133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bf2d6fcb744afaa1b0ab74ab4f3fde)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.473031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.526264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bf2d6fcb744afaa1b0ab74ab4f3fde', 'request_id': 'req-471578c1-6bad-452e-a110-ccd7f6e1cbf9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.533519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bf2d6fcb744afaa1b0ab74ab4f3fde', 'request_id': 'req-471578c1-6bad-452e-a110-ccd7f6e1cbf9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.540296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bf2d6fcb744afaa1b0ab74ab4f3fde', 'request_id': 'req-471578c1-6bad-452e-a110-ccd7f6e1cbf9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.552207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] The token cache is being invalidate because project 75bf2d6fcb744afaa1b0ab74ab4f3fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:25.552537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.553335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-471578c1-6bad-452e-a110-ccd7f6e1cbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:25.554985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 911/1802] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:25 2022] DELETE /identity/v3/projects/75bf2d6fcb744afaa1b0ab74ab4f3fde => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:25.560151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.560473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.560760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.582035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:25.583239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:25.632961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:25.651774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 892/1803] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:25.661117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.661400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.661671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.681591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:25.682843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:25.690637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 912/1804] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:25.695609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.705625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e362a6-8b59-4b8c-b053-94b5711e1408 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.711326 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.711930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.712207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.712466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.713105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:25.713399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.715045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.727821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 893/1805] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:25.733510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.743693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09aeec-8083-4824-ad1f-8c3e1514752c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.748615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.749221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.749545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.749874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.750560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.752506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.757829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:25.787022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 913/1806] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:25 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:25.788378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.799349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5340ea-9d13-48eb-b242-60c66fccdf0a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.858151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.858755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.859030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.859299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.859921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.861832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.889558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 894/1807] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:25 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:25.893651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.904106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c19b66-9dd6-45d6-9ac7-40834b6c1843 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.908714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.909300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.909570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.909831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.910496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.912105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.921699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 914/1808] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:25.925595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.935990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefaf52-b827-41de-9a1f-57b22be336a0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.940666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.941264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.941543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.941810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:25.942499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:25.944133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685ef5-2165-4135-af98-f3ae3d08638e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:25.957643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 895/1809] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:25.964827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:25.976424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab298fd-fb83-4e44-b856-56e1479f70ee admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:25.981360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:25.982067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:25.982427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:25.982763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] PATH_INFO: `/v3/projects/8c177311a9104fd58e2c535f76d7e7ca/users/05d80ab27620489b9d97ab010060969b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.004039 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c177311a9104fd58e2c535f76d7e7ca, user_id=05d80ab27620489b9d97ab010060969b, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.007113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.031502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 915/1810] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:25 2022] PUT /identity/v3/projects/8c177311a9104fd58e2c535f76d7e7ca/users/05d80ab27620489b9d97ab010060969b/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:26.048883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.049413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.049413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.086090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] MFA Rules not processed for user `05d80ab27620489b9d97ab010060969b`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:26.087469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.178178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 896/1811] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:26.183034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.269857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb407fd2-b77f-447c-a0de-b1e8ddf747c6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.281268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.282433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.282711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.282981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.283623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.286271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.323540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 916/1812] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:26 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:26.328458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.343920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aafd8-d946-4289-b37a-1e6769515462 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.408045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:26.415157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.417228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.425026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.425638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.425946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.426211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.426818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.428793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.454497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 897/1813] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:26 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:26.459256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.471042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a286-4bfa-415e-abf3-114b856941e2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.476310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.477117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.477528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.477975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.478886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.480553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.492959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 898/1814] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:26.493530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.495403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.499842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f714e-7309-46a1-b814-542ffadc1c10 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.503571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.504183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.504461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.504729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.507037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.508802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a36d54-7133-4cdc-99ab-ef5ce65419fd admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.513360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.514007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.514342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.514602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] PATH_INFO: `/v3/users/32f4e1f92a7d4a8a8d84d9f52e486bc1` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.515697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f4e1f92a7d4a8a8d84d9f52e486bc1)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.517576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.579662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f4e1f92a7d4a8a8d84d9f52e486bc1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:26.586486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:26.589591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f4e1f92a7d4a8a8d84d9f52e486bc1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:26.603209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f4e1f92a7d4a8a8d84d9f52e486bc1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:26.603875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f4e1f92a7d4a8a8d84d9f52e486bc1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:26.604501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-209c9f8a-fa7f-42b5-b7ce-5feba49fe429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f4e1f92a7d4a8a8d84d9f52e486bc1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:26.604874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.606357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.615919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 917/1815] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:26.616756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.623242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 899/1816] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:26 2022] DELETE /identity/v3/users/32f4e1f92a7d4a8a8d84d9f52e486bc1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:26.627573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.627882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.627991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc5ba-4195-4813-961a-ba3fd90a4869 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.628335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.657396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:26.658646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.706743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.707621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.708099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.708375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] PATH_INFO: `/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7/users/e07af142ce5a4f12bbf06532d99b0460/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.725083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab256a7b3b254f11945bd05cfc12a4e7, user_id=e07af142ce5a4f12bbf06532d99b0460, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.727916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.745026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 918/1817] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:26 2022] PUT /identity/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7/users/e07af142ce5a4f12bbf06532d99b0460/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:26.748687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.750623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.789975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 900/1818] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:26.799468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.800888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.833094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396e42-8d55-45e6-ab50-fec03f3745f4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.841665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.842590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.842944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.844146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.844886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.846660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.849937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:26.866666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 919/1819] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:26.871428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:26.898479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0ca81-0d9e-4d7d-b8ef-0e4dbd0304bb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.906240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f797-1736-416e-9aa2-d7ec4d05da70 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:26.907447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.908120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.908392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.908662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] PATH_INFO: `/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7/users/e07af142ce5a4f12bbf06532d99b0460/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.911062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab256a7b3b254f11945bd05cfc12a4e7, user_id=e07af142ce5a4f12bbf06532d99b0460, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:26.913762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8676492-0753-470b-aeb5-e73b88261b32 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:26.925554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 920/1820] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:26 2022] PUT /identity/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7/users/e07af142ce5a4f12bbf06532d99b0460/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:26.938787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.939063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.939336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.986765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] MFA Rules not processed for user `e07af142ce5a4f12bbf06532d99b0460`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:26.988166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:26.988704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:26.988934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:26.989099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:26.989390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:26.999931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.001298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.020477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 901/1821] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:27.046014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:27.054406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.056024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.086112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 921/1822] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:27.098498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.100748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.147505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0415b-766e-488c-8cbf-511aec62cbd1 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.181751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f716c-d069-4368-88e6-50fce1b839d2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.201297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.201983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.202281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.202541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.218916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.220452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.224126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73ff6235808247cca3644f43387288b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec2781b3b0b42c28aa98efbec87aeeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.224947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.225120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.225498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.226249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:27.226551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.228147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.241837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 922/1823] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:27.244148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 902/1824] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:27.248084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.263444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d0aca-406a-41a5-abcf-27f09007058b service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.269038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73ff6235808247cca3644f43387288b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec2781b3b0b42c28aa98efbec87aeeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.269939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.270214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.270486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.271651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.273705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.316797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 923/1825] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:27 2022] POST /identity/v3/projects => generated 354 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:27.320939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.335159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815847-ca16-4a4f-a5d5-d776a9cfacdc tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.392356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:27.427512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73ff6235808247cca3644f43387288b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec2781b3b0b42c28aa98efbec87aeeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.428143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.428425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.429156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.429518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:27.429832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.431745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.457234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 903/1826] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:27.487112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.489206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.508408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.525292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89d595-5b29-49a7-b7ba-27832130c3f8 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.539311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73ff6235808247cca3644f43387288b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fec2781b3b0b42c28aa98efbec87aeeb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.539975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.540259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.540531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] PATH_INFO: `/v3/projects/898ddf35180040f1887625a16d79fe15` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.541707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=898ddf35180040f1887625a16d79fe15)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.552290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.607022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ee4d-8c45-4cab-84dd-ed89a2d49ae0 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.613135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.614581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.615052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.615481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] PATH_INFO: `/v3/projects/d195011d24f44822a101d62ebfca432d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.618097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d195011d24f44822a101d62ebfca432d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.620454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.655843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898ddf35180040f1887625a16d79fe15', 'request_id': 'req-f4ce74bb-9b83-4224-80c0-ccb783b945f4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.672548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898ddf35180040f1887625a16d79fe15', 'request_id': 'req-f4ce74bb-9b83-4224-80c0-ccb783b945f4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.690494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd195011d24f44822a101d62ebfca432d', 'request_id': 'req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.691998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898ddf35180040f1887625a16d79fe15', 'request_id': 'req-f4ce74bb-9b83-4224-80c0-ccb783b945f4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.699307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd195011d24f44822a101d62ebfca432d', 'request_id': 'req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.701825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:27.708533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd195011d24f44822a101d62ebfca432d', 'request_id': 'req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.716874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] The token cache is being invalidate because project 898ddf35180040f1887625a16d79fe15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:27.721755 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.722698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.730717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 904/1827] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/projects/898ddf35180040f1887625a16d79fe15 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:27.738727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] The token cache is being invalidate because project d195011d24f44822a101d62ebfca432d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:27.739093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.740069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:27.741974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 924/1828] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/projects/d195011d24f44822a101d62ebfca432d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:27.745804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.747478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.840406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce74bb-9b83-4224-80c0-ccb783b945f4 tempest-VolumeQuotaClassesTest-429089147 tempest-VolumeQuotaClassesTest-429089147-project-admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.847564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:27.850458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:27.940781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.941862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.942426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.942598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce16c-137f-4a31-9ab7-d731f1c47bfb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:27.943605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] PATH_INFO: `/v3/users/bb3187713aa0498796e866023e49fa4e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.945054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3187713aa0498796e866023e49fa4e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.947064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:27.948819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:27.949155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:27.949452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:27.949728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:27.950038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] PATH_INFO: `/v3/users/05d80ab27620489b9d97ab010060969b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:27.951322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d80ab27620489b9d97ab010060969b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:27.953405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.012292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d80ab27620489b9d97ab010060969b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.021487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d80ab27620489b9d97ab010060969b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.032841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3187713aa0498796e866023e49fa4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.039942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d80ab27620489b9d97ab010060969b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.042979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3187713aa0498796e866023e49fa4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.047810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d80ab27620489b9d97ab010060969b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.048768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d80ab27620489b9d97ab010060969b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.055651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 925/1829] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/users/05d80ab27620489b9d97ab010060969b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:28.056494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.058157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.060894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3187713aa0498796e866023e49fa4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.062340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3187713aa0498796e866023e49fa4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.063334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49982414-373c-4564-a107-c05c17f1763f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3187713aa0498796e866023e49fa4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.078981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 905/1830] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:27 2022] DELETE /identity/v3/users/bb3187713aa0498796e866023e49fa4e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:28.080258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.080540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.080812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.112678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:28.114247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.144176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2841-2bdf-4515-94e5-4aef66bee6c0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.155590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:28.190375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 906/1831] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:28.203329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.205019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.215382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.216045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.216323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.216592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] PATH_INFO: `/v3/users/4a66b9b0aa2c4494ba581a75d742392e` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.218297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a66b9b0aa2c4494ba581a75d742392e)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.220364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.271804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb06c-1563-484e-9a03-27951548011a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.280433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.281057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.281459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.281728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.287648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a66b9b0aa2c4494ba581a75d742392e'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.295114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.297020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17f098-e228-452f-80b8-85288c45d484 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.299240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a66b9b0aa2c4494ba581a75d742392e'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.309497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 907/1832] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:28.314571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a66b9b0aa2c4494ba581a75d742392e'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.322457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a66b9b0aa2c4494ba581a75d742392e'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.323180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a66b9b0aa2c4494ba581a75d742392e'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.329634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 926/1833] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:28 2022] DELETE /identity/v3/users/4a66b9b0aa2c4494ba581a75d742392e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:28.334798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.335081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.335349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.358820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:28.360017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.378107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:28.430977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 908/1834] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:28.441471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.443568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.505482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.507546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:28.524989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63eef-ba81-4b0b-af71-87f2d0efb1b3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.528992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b6e45-62e8-45fe-9ef3-7ffdf552b33e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.533490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.534918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.535272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.535684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.542046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.542695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.543088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.543369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] PATH_INFO: `/v3/projects/b5310a6b91c0489ab3d55ff5e5409412` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.544719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5310a6b91c0489ab3d55ff5e5409412)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.546928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.569700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.571342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.585667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 927/1835] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:28.612332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5310a6b91c0489ab3d55ff5e5409412', 'request_id': 'req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.626256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5310a6b91c0489ab3d55ff5e5409412', 'request_id': 'req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.658887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5310a6b91c0489ab3d55ff5e5409412', 'request_id': 'req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.676035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] The token cache is being invalidate because project b5310a6b91c0489ab3d55ff5e5409412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:28.676869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.677411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.682621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 909/1836] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:28 2022] DELETE /identity/v3/projects/b5310a6b91c0489ab3d55ff5e5409412 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:28.684104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:28.698216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372306d3-94e3-4b0e-92d0-a1b461638ac7 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:28.770062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:28.820735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:28.821634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:28.822464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:28.822946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] PATH_INFO: `/v3/users/8eec5248430843c5890b5daa9d44ddab` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:28.824291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eec5248430843c5890b5daa9d44ddab)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:28.826705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:28.909919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eec5248430843c5890b5daa9d44ddab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.921011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eec5248430843c5890b5daa9d44ddab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.938186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eec5248430843c5890b5daa9d44ddab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.947924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eec5248430843c5890b5daa9d44ddab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.948774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eec5248430843c5890b5daa9d44ddab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:28.957171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 928/1837] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:28 2022] DELETE /identity/v3/users/8eec5248430843c5890b5daa9d44ddab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:29.397365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:29.399513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:29.412930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2de5c-c95a-4b28-95f6-8d6a557cee5b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:29.505143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:29.506567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:29.507008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:29.508505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] PATH_INFO: `/v3/projects/8c177311a9104fd58e2c535f76d7e7ca` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:29.509250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c177311a9104fd58e2c535f76d7e7ca)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:29.514044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:29.582804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:29.585258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c177311a9104fd58e2c535f76d7e7ca', 'request_id': 'req-ce368a56-fc7f-4a77-96f1-f29f30a61286'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.595302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c177311a9104fd58e2c535f76d7e7ca', 'request_id': 'req-ce368a56-fc7f-4a77-96f1-f29f30a61286'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.607592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c177311a9104fd58e2c535f76d7e7ca', 'request_id': 'req-ce368a56-fc7f-4a77-96f1-f29f30a61286'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.623414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] The token cache is being invalidate because project 8c177311a9104fd58e2c535f76d7e7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:29.623414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.624731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.633674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 910/1838] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:29 2022] DELETE /identity/v3/projects/8c177311a9104fd58e2c535f76d7e7ca => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:29.635068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:29.636296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:29.655960 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7efd2-15a9-4dd6-b917-985afd70d226 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:29.733704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:29.734387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:29.734844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:29.735101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] PATH_INFO: `/v3/users/e07af142ce5a4f12bbf06532d99b0460` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:29.736264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07af142ce5a4f12bbf06532d99b0460)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:29.738851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:29.871652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07af142ce5a4f12bbf06532d99b0460'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.900532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07af142ce5a4f12bbf06532d99b0460'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.903390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:29.920777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07af142ce5a4f12bbf06532d99b0460'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.929729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07af142ce5a4f12bbf06532d99b0460'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.930488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07af142ce5a4f12bbf06532d99b0460'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:29.939821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 929/1839] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:29 2022] DELETE /identity/v3/users/e07af142ce5a4f12bbf06532d99b0460 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:30.289046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:30.291106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:30.310078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce368a56-fc7f-4a77-96f1-f29f30a61286 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:30.453497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:30.454306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.454557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.455059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] PATH_INFO: `/v3/projects/9142a46542fe4800b524dc8778d033cc` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.456204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9142a46542fe4800b524dc8778d033cc)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:30.458328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:30.533886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9142a46542fe4800b524dc8778d033cc', 'request_id': 'req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.542092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9142a46542fe4800b524dc8778d033cc', 'request_id': 'req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.551655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9142a46542fe4800b524dc8778d033cc', 'request_id': 'req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.565933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] The token cache is being invalidate because project 9142a46542fe4800b524dc8778d033cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:30.566364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.567134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.569353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 911/1840] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:30 2022] DELETE /identity/v3/projects/9142a46542fe4800b524dc8778d033cc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:30.573405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:30.574941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:30.589553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc2bf4-98ce-4021-bf32-8ded675220a8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:30.656697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:30.657604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.658085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.658473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] PATH_INFO: `/v3/users/73ff6235808247cca3644f43387288b6` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.659761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ff6235808247cca3644f43387288b6)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:30.663759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:30.688061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:30.689499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:30.706422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e468-74d1-4ccd-a82c-0c3aedeae7b3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:30.713492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:30.714192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.714570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.714968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] PATH_INFO: `/v3/projects/193b59cfe3f9497f821532dc9c09cfe7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.716505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193b59cfe3f9497f821532dc9c09cfe7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:30.719671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:30.742115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ff6235808247cca3644f43387288b6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.753533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ff6235808247cca3644f43387288b6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.772618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ff6235808247cca3644f43387288b6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.786468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ff6235808247cca3644f43387288b6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.788155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-209143fc-5a19-4692-aeb9-bf011144d7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ff6235808247cca3644f43387288b6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.796284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 930/1841] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:30 2022] DELETE /identity/v3/users/73ff6235808247cca3644f43387288b6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:30.825396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193b59cfe3f9497f821532dc9c09cfe7', 'request_id': 'req-59bbfd2c-db60-4743-a99a-d00585d76c06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.832440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193b59cfe3f9497f821532dc9c09cfe7', 'request_id': 'req-59bbfd2c-db60-4743-a99a-d00585d76c06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.842422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193b59cfe3f9497f821532dc9c09cfe7', 'request_id': 'req-59bbfd2c-db60-4743-a99a-d00585d76c06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.844121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:30.861631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] The token cache is being invalidate because project 193b59cfe3f9497f821532dc9c09cfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:30.861959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.862813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-59bbfd2c-db60-4743-a99a-d00585d76c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:30.866136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 912/1842] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:30 2022] DELETE /identity/v3/projects/193b59cfe3f9497f821532dc9c09cfe7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:30.871198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:30.871872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:30.872343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:30.917183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:30.918576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:30.975776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:30.991505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 931/1843] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.001146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.001432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.001701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.022416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.023872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.033601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 913/1844] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:31.038284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.051066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2509da-22e1-4d12-9bbd-73827056841d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.058558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.059659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.060030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.060449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.061223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:31.061689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.063470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.085490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 932/1845] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:31.086770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.098589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad9574-4f11-4ab7-bc05-9b3414a7ba73 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.103731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.104579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.105036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.105404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.106165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.108153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.161660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.174117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 914/1846] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:31.177842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60d504-c53c-47e7-8d46-5270e82c1738 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.259126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.260262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.260833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.261467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.267137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.270138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.301382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 933/1847] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:31.306228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.319886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2e8c-52e9-44e8-9101-69608077c0c1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.333889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.334666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.335010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.335348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.336061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.337725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5baf3c-ec59-4f5d-a3d3-649449041483 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.351401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 915/1848] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:31.355458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.374633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9176c1-53bc-49c7-b58d-e53ba1c6d383 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.383113 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.384610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.384610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.384610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.389772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.389772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b2c22-7638-410c-a82c-4b230212c716 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.425106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b6b4-bdca-4d16-95a8-80700f021167 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.426404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b6b4-bdca-4d16-95a8-80700f021167 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.427892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2b6b4-bdca-4d16-95a8-80700f021167 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.429980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 916/1849] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:20:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:31.440752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 934/1850] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:31.458109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b6b4-bdca-4d16-95a8-80700f021167 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.533837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.534427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.535159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.543597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2b6b4-bdca-4d16-95a8-80700f021167 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:31.573773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:31.574892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.575357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.575817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] PATH_INFO: `/v3/projects/408ad49ccace4b8c9d4fcdb9385d4799/users/9e013a6a9b50491a855c0a673b7025ec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.613131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=408ad49ccace4b8c9d4fcdb9385d4799, user_id=9e013a6a9b50491a855c0a673b7025ec, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:31.619637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac56aed-457e-4bea-bcc7-dd8dec021cdc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:31.636463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.639993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.658190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 917/1851] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:31 2022] PUT /identity/v3/projects/408ad49ccace4b8c9d4fcdb9385d4799/users/9e013a6a9b50491a855c0a673b7025ec/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:31.678436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:31.678832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:31.678989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:31.734402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] MFA Rules not processed for user `9e013a6a9b50491a855c0a673b7025ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:31.736162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:31.771836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 935/1852] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:31.869788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:31.872196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 918/1853] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:31.990263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.005842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63edb-d2da-458c-b961-ea07a8d60325 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.012198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.012449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.012696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.012965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.013592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.015558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.046575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 936/1854] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:31 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:32.050307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.062506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea371ad-f29a-4d00-8b76-2f9cd4601414 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.069697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.071525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.163254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.163882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.164159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.164859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.165039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.181000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deebf1e-5dd8-4f9e-883c-6f4c43c7d5c6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.182836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.187125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.188068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.188553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.189028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] PATH_INFO: `/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.202976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab256a7b3b254f11945bd05cfc12a4e7)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.207969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.217389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 919/1855] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:32.222289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.232553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.239024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f08c00-f779-423a-bee4-013735d23f6a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.248103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.248964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.249601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.250510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.251628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.254118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.273174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 920/1856] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:32.278164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.293061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c33c7-ecee-413a-b706-1c0c58c2c51b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.298478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab256a7b3b254f11945bd05cfc12a4e7', 'request_id': 'req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.317242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab256a7b3b254f11945bd05cfc12a4e7', 'request_id': 'req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.330954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab256a7b3b254f11945bd05cfc12a4e7', 'request_id': 'req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.355835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] The token cache is being invalidate because project ab256a7b3b254f11945bd05cfc12a4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:32.356394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.358073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.361368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 937/1857] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:32 2022] DELETE /identity/v3/projects/ab256a7b3b254f11945bd05cfc12a4e7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:32.362086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.364118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.440192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.441365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.441795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.442114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] PATH_INFO: `/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5/users/47bbaf4d750048c1afd10a75738f0028/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.467948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0ad20bf2fa40f99c433b4f20915ad5, user_id=47bbaf4d750048c1afd10a75738f0028, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.473522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.474551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d6e-73c9-441c-aa62-fbbc87b4b0d0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.480638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.481404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.481699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.481984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] PATH_INFO: `/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.483504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec2781b3b0b42c28aa98efbec87aeeb)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.485345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.497593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 921/1858] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:32 2022] PUT /identity/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5/users/47bbaf4d750048c1afd10a75738f0028/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:32.499412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.503171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.504926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.579782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec2781b3b0b42c28aa98efbec87aeeb', 'request_id': 'req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.579782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec2781b3b0b42c28aa98efbec87aeeb', 'request_id': 'req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.590786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec2781b3b0b42c28aa98efbec87aeeb', 'request_id': 'req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.617795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] The token cache is being invalidate because project fec2781b3b0b42c28aa98efbec87aeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:32.618342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.619105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7efe6ea9-0a12-47d9-82fc-42ea3681a0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:32.625102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 938/1859] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:32 2022] DELETE /identity/v3/projects/fec2781b3b0b42c28aa98efbec87aeeb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:32.625102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.625102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.625102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.637008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d71d3-c450-4fc9-bfc1-c8c51c5acd92 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.648631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.650093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.710263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.711091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.711606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.711978 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.714000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.718036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 939/1860] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:32.718896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.724860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.732808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.734651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774738d-0590-4813-b3bd-948d3fa58143 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.738508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7a45-f382-41f8-8888-5b163f5ea68c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.740988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:32.745286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.745996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.746440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.746643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 922/1861] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:32.746829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.747702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.748190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.748484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.748829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.749764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce051-fe38-4931-95bb-bba2e0186a28 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.764615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 940/1862] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:32.771600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.772241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377509-4d47-4f60-b53e-cedf6acecafa None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.772695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377509-4d47-4f60-b53e-cedf6acecafa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.772996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377509-4d47-4f60-b53e-cedf6acecafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.773538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.783573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 923/1863] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:32.790547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.815904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-9b377509-4d47-4f60-b53e-cedf6acecafa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.817397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9b377509-4d47-4f60-b53e-cedf6acecafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.819746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f62d2-d4c4-4b88-a674-f3555ccd379f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:32.826556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 941/1864] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:32.828036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec6d8a-cb64-4012-a545-b67e44260046 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.829131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec6d8a-cb64-4012-a545-b67e44260046 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.829131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec6d8a-cb64-4012-a545-b67e44260046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.831436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:32.832713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.833094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.833425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] PATH_INFO: `/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5/users/47bbaf4d750048c1afd10a75738f0028/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:32.835850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0ad20bf2fa40f99c433b4f20915ad5, user_id=47bbaf4d750048c1afd10a75738f0028, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:32.840307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:32.853068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b1ec6d8a-cb64-4012-a545-b67e44260046 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:32.855772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b1ec6d8a-cb64-4012-a545-b67e44260046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:32.883856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 924/1865] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:32 2022] PUT /identity/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5/users/47bbaf4d750048c1afd10a75738f0028/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:32.884966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:32.949647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 942/1866] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:32.952134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:32.952707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:32.953169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.024986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] MFA Rules not processed for user `47bbaf4d750048c1afd10a75738f0028`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:33.026423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.051041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df630b-bda5-43af-b6f0-e3e607549c1c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.054539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.065668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.066466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.066812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.067150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.068477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:33.068847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.070906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.084277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 925/1867] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:33.085332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.097929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002b68-a052-4f66-9253-cf4d477e3628 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.105440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.107150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.107150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.107150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.107661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:33.107984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.110449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.133742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 926/1868] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:33.135443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.150733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0012-5012-472a-ac21-fed71853ce2b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.157168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.158265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.158743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.159218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.160093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.163197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.196102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 943/1869] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:33.197002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.208890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80d9f5-f6c4-4e71-89ad-7783556a52e8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.214866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.215770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.216053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.216316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.216943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.219111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.220841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 927/1870] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:33.222089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.224535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.257153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 944/1871] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:33.258236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.301484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a644af3-9a74-4b45-bcfa-162bb7438636 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.329832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213b72d-4169-4ff3-8a10-4318ead56c2d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.335742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.336354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.336629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.336899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.337517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.339520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.360382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.361213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.361596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.362042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.373653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.387189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 945/1872] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:33.388494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.403697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e7b8-72ff-48c2-9b79-b3d8cd1c7470 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.410328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.411629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.411912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.412180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.413707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.415692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.447263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 946/1873] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:33.448022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.462408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dff67a-2a79-4ab8-b63e-3341d2656f36 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.468483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.469122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.469397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.469664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.470951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.471362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.472621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.473526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.485702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 928/1874] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:33.486332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 947/1875] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:33.487107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.491121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.499262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95acd1-0373-4a18-a133-ad722f3f81ee service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.504314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80718-d092-4e9d-919e-833ad37eda54 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.505738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.506792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.507381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.507829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.508648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.509510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.510267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.510605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.511215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.511320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.511989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.514092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.530227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 929/1876] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:33.534506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.541286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 948/1877] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:33.545795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.548483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e3a9-070f-402b-b09c-ba71777710cb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.556596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.557607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.558145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.558703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.559758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.562532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.565059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb9a2-4e00-46c8-82bb-a3bd1c07ce33 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.570815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.571568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.571896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.572165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] PATH_INFO: `/v3/projects/a22075e1a1aa45f28adbafc0f0850149/users/bd4b405c2fa04e8793f2e6f55f54247f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.579854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 930/1878] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:33.589071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.594521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22075e1a1aa45f28adbafc0f0850149, user_id=bd4b405c2fa04e8793f2e6f55f54247f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.597442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.609696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf485e-f550-4bff-b4ee-00fa0b93c6f0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.620685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 949/1879] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:33 2022] PUT /identity/v3/projects/a22075e1a1aa45f28adbafc0f0850149/users/bd4b405c2fa04e8793f2e6f55f54247f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:33.620685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.621994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.657710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.704581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aebf3-dd77-411a-80ac-0e07ceff5b94 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.718518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.718840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.719214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.719627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.721611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.726663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.727336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.727608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.727874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] PATH_INFO: `/v3/projects/3f257e7409ca479c9c0140daf8d86fc3/users/9254e4285708401190dac06fdf0ad2b3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.745210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f257e7409ca479c9c0140daf8d86fc3, user_id=9254e4285708401190dac06fdf0ad2b3, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.748162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f009c-c325-4a68-9285-61eb1051eee4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.767336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 931/1880] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:33 2022] PUT /identity/v3/projects/3f257e7409ca479c9c0140daf8d86fc3/users/9254e4285708401190dac06fdf0ad2b3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:33.768534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.768818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.769655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.803549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.805234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2209e-2aea-45d6-ae08-9e234dd8b0ef service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.806234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] MFA Rules not processed for user `bd4b405c2fa04e8793f2e6f55f54247f`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:33.807608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.815328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 950/1881] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:33.816671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.817041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.817375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.847950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] MFA Rules not processed for user `9254e4285708401190dac06fdf0ad2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:33.850000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:33.879295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:33.893786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 932/1882] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:33.899664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.957843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 951/1883] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:33.962434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:33.965927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7d9b-647e-4735-ad28-11cc7ae9979e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.971913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.972457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.972734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.973002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.973623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.974767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb829b-41a5-4723-8f87-7b45d8042dba None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:33.976097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:33.980532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:33.981240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:33.981644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:33.981979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:33.982665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:33.984869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.007358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 933/1884] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:34.011662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.018706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 952/1885] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:33 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:34.020116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.060434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.088366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f48058-5fc8-4c0e-9cbb-f4f5021b3b1d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.093313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.094029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.094381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.094724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.099557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.108451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e088ede-3703-4c6e-a413-6960d62a7f30 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.110932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.116208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.117251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.117873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.118415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.119457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.123130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.164585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 953/1886] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:34.166240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 934/1887] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:34.168686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.169464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.181091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fe06-2f86-4b36-b577-edfb9de82fc0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.187524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ddeb3-e353-4425-9eb6-655e57aa39cc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.187651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.187651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.188270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.188546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.189542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.191309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.202776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.203496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.203895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.204592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.206526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.207925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 954/1888] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.209243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.218301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.225746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 935/1889] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.226930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.233519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579ef6d-9cc9-480c-9e8f-62a489cbedee admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.238514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.238693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f182a-6662-42b4-8f96-cd9d2b9bbb75 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.239335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.239707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.240003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] PATH_INFO: `/v3/projects/f8731a9a942849a8afb12e4af326af27/users/6305fdb5bca2442f8dd47bb69298a547/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.246899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.247692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.248117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.248555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.249456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.252215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.257221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8731a9a942849a8afb12e4af326af27, user_id=6305fdb5bca2442f8dd47bb69298a547, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.260557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.265025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 936/1890] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.269763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.276641 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 955/1891] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/f8731a9a942849a8afb12e4af326af27/users/6305fdb5bca2442f8dd47bb69298a547/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.280263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.280577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6fb3-7055-427c-be88-978ebcd98eed admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.331116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.348049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.348713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.349052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.349327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] PATH_INFO: `/v3/projects/f4828b64673b470f92c0d9c824d6728a/users/99b13aecb29d4698873d29cc9bce6961/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.354045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd398329-009a-4175-acdf-99fc9c684085 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.358844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.359525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.359873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.360146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.360790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.362429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.365957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4828b64673b470f92c0d9c824d6728a, user_id=99b13aecb29d4698873d29cc9bce6961, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.368921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ca87a-954c-4c37-9087-b1c99f4b28bb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.373720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 956/1892] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:34.378634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.389363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021797-4596-4ce5-af3d-4cf7ec7c3bb4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.398981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 937/1893] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/f4828b64673b470f92c0d9c824d6728a/users/99b13aecb29d4698873d29cc9bce6961/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.409408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.409775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.410173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.440331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] MFA Rules not processed for user `99b13aecb29d4698873d29cc9bce6961`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:34.441725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.447907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.448602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.448879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.449164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] PATH_INFO: `/v3/projects/f8731a9a942849a8afb12e4af326af27/users/6305fdb5bca2442f8dd47bb69298a547/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.451059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8731a9a942849a8afb12e4af326af27, user_id=6305fdb5bca2442f8dd47bb69298a547, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.453674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2378c2-248e-416a-b404-511def2f1354 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.463653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 957/1894] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/f8731a9a942849a8afb12e4af326af27/users/6305fdb5bca2442f8dd47bb69298a547/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.475756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.475963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.476232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.504752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] MFA Rules not processed for user `6305fdb5bca2442f8dd47bb69298a547`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:34.506551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:34.510777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.523318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 938/1895] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:34.524197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.534647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3dd5-34d4-4488-a6f7-fa3fe8e6db7b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.581180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 958/1896] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:34.591419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.592037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.592385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.592661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.593267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.593510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.595207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.625626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 939/1897] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:34.626715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.651714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc280d2-80a5-40b7-92ad-facd7f262daf None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.688125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.709972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33954b-67dc-44e0-88de-07c2db5546a9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.726789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.727319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.727644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.728055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.728678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.731225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.748491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.749202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.749507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.749773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.756888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 940/1898] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:34 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:34.760843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.782653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3e30-fd19-4bcf-90d5-f0df6ae27b57 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.797941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.798574 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.798851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.799119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.800562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.805179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.823671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 941/1899] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:34.824998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.837956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84962-518e-4682-8964-9c16b02e4f41 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.838703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.840382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.843529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:34.843861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:34.844227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:34.844593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] PATH_INFO: `/v3/projects/d9a4b592f6c1444db60ea44001e5c34e/users/3121e5f74fd04592b49a68a15324494e/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:34.853650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 959/1900] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:34.881462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a4b592f6c1444db60ea44001e5c34e, user_id=3121e5f74fd04592b49a68a15324494e, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:34.884018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:34.932962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 942/1901] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:34 2022] PUT /identity/v3/projects/d9a4b592f6c1444db60ea44001e5c34e/users/3121e5f74fd04592b49a68a15324494e/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:34.937296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:34.953800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e3efe-dcf7-4487-a112-000e2079daa3 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:34.958378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:34.978651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.033617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.034429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.034775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.035163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.035880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.037855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.049535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 960/1902] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:35.054307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.062435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7dcb-c0cc-4f0d-bf90-7a9dd832b234 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.065243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91833f-996f-44d7-a99d-67949f0cee9d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.069084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.070096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.070408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.071114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.071221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.071544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.071862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.071963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] PATH_INFO: `/v3/projects/d9a4b592f6c1444db60ea44001e5c34e/users/3121e5f74fd04592b49a68a15324494e/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.074316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a4b592f6c1444db60ea44001e5c34e, user_id=3121e5f74fd04592b49a68a15324494e, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.077737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896e8c7-ae1c-44c4-a0ed-3967457dfb86 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.089738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 961/1903] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:35 2022] PUT /identity/v3/projects/d9a4b592f6c1444db60ea44001e5c34e/users/3121e5f74fd04592b49a68a15324494e/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:35.101795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.102075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.102572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.135549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] MFA Rules not processed for user `3121e5f74fd04592b49a68a15324494e`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:35.137015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:35.182831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.187183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.207454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 943/1904] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:35.338098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 962/1905] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:35.471767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.483764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec00c8-40f8-4f0e-8f0a-0d805d0a0202 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.573893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.576277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.577598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.578235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.599807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.602096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.613523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:35.626462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 944/1906] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:35.689053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:35.707836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811ba9-9326-4f66-bdd7-804d3bc6f47e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:35.712341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:35.713174 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:35.713457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:35.713741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:35.781677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:35.783434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d84f96-a32d-4577-9fa0-f6661bc02eae service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:35.793255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 963/1907] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:37.729962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:37.806980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e2cf7-151e-474b-bb63-7f923751f284 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:37.811846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:37.812492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:37.812770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:37.813040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] PATH_INFO: `/v3/users/9e013a6a9b50491a855c0a673b7025ec` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:37.814513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e013a6a9b50491a855c0a673b7025ec)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:37.816428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:37.882335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e013a6a9b50491a855c0a673b7025ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:37.899311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e013a6a9b50491a855c0a673b7025ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:37.944390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e013a6a9b50491a855c0a673b7025ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:37.945894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e013a6a9b50491a855c0a673b7025ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:37.946748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e013a6a9b50491a855c0a673b7025ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:37.970644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:37.971207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:37.971586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:37.974482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 945/1908] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:37 2022] DELETE /identity/v3/users/9e013a6a9b50491a855c0a673b7025ec => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:38.010850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:38.012264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.030080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:38.117587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 964/1909] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:38.133435 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.135134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.233942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8443ab1-b3a2-4227-b7e7-ce103cc2e558 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:38.240525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:38.241370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:38.242642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:38.242920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:38.260863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:38.262348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:38.275806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 946/1910] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:38.767003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.768556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.787657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee59f-6a3c-4089-9067-22b7c6024924 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:38.794970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:38.796448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:38.796904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:38.797441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] PATH_INFO: `/v3/projects/408ad49ccace4b8c9d4fcdb9385d4799` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:38.799323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=408ad49ccace4b8c9d4fcdb9385d4799)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:38.802654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:38.878036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.879698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.883386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408ad49ccace4b8c9d4fcdb9385d4799', 'request_id': 'req-08a9513d-77f6-4b73-867f-0db1d48d3a8c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.894746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408ad49ccace4b8c9d4fcdb9385d4799', 'request_id': 'req-08a9513d-77f6-4b73-867f-0db1d48d3a8c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.898664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e829f-968b-4cde-8aef-4d5ee4b88a91 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:38.904289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408ad49ccace4b8c9d4fcdb9385d4799', 'request_id': 'req-08a9513d-77f6-4b73-867f-0db1d48d3a8c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.917199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] The token cache is being invalidate because project 408ad49ccace4b8c9d4fcdb9385d4799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:38.917640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.918412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:38.920360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 965/1911] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:38 2022] DELETE /identity/v3/projects/408ad49ccace4b8c9d4fcdb9385d4799 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:38.924495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:38.925936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:38.936439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:38.986160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:38.986893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:38.987252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:38.987534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] PATH_INFO: `/v3/users/9254e4285708401190dac06fdf0ad2b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:38.988744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9254e4285708401190dac06fdf0ad2b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:38.990751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.032807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9513d-77f6-4b73-867f-0db1d48d3a8c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.040581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.040804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.041502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.041621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] PATH_INFO: `/v3/users/47bbaf4d750048c1afd10a75738f0028` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.045242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bbaf4d750048c1afd10a75738f0028)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.047219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.068554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9254e4285708401190dac06fdf0ad2b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.078928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9254e4285708401190dac06fdf0ad2b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.094455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9254e4285708401190dac06fdf0ad2b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.095169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9254e4285708401190dac06fdf0ad2b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.095775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8a124bd-97ee-484a-8ced-c94b107b24f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9254e4285708401190dac06fdf0ad2b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.096241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:39.104043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bbaf4d750048c1afd10a75738f0028'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.112842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bbaf4d750048c1afd10a75738f0028'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.117473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 947/1912] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:38 2022] DELETE /identity/v3/users/9254e4285708401190dac06fdf0ad2b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:39.118344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1af3f-886d-4309-b95c-1cd54d531c5f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.118625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1af3f-886d-4309-b95c-1cd54d531c5f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.118894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1af3f-886d-4309-b95c-1cd54d531c5f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.127793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 948/1913] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:20:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:20:39.129277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.129685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.130018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.133869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bbaf4d750048c1afd10a75738f0028'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.141828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bbaf4d750048c1afd10a75738f0028'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.142519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-56c1ce7e-8942-4a27-9b2e-106ce1df735c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bbaf4d750048c1afd10a75738f0028'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.150952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 966/1914] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:38 2022] DELETE /identity/v3/users/47bbaf4d750048c1afd10a75738f0028 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:39.152325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.152602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.152866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.155930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:39.157611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.190373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:39.191797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.242145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 949/1915] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:39.252970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.254533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.286284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 967/1916] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:39.295568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.297258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.312540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a55fb-5ff7-4f6c-b1ec-9a4ea46ddbc5 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.314987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:39.321185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.323185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.323335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.323742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.337599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.341927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7328-37b5-4890-9f4d-9d1933b004ad None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.342481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.346487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.347366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.347909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.348349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.361787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.363658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.370307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 968/1917] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:39.378865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 950/1918] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:39.759122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.761549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.778894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4186f-db51-44c3-a5ca-5076856675a0 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.784274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.785148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.785148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.785577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] PATH_INFO: `/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.787836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0ad20bf2fa40f99c433b4f20915ad5)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.790635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.800054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.801962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.820982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549395c-f5f7-45c1-9c0f-2f3975f1e799 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.826968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:39.827812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.828091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.828415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] PATH_INFO: `/v3/projects/3f257e7409ca479c9c0140daf8d86fc3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.829662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f257e7409ca479c9c0140daf8d86fc3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:39.831911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:39.849359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0ad20bf2fa40f99c433b4f20915ad5', 'request_id': 'req-251381a4-6882-4265-aee9-688866c8c6f0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.863238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0ad20bf2fa40f99c433b4f20915ad5', 'request_id': 'req-251381a4-6882-4265-aee9-688866c8c6f0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.870486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0ad20bf2fa40f99c433b4f20915ad5', 'request_id': 'req-251381a4-6882-4265-aee9-688866c8c6f0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.882182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] The token cache is being invalidate because project 7a0ad20bf2fa40f99c433b4f20915ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:39.882469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.883116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-251381a4-6882-4265-aee9-688866c8c6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.884681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 969/1919] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:39 2022] DELETE /identity/v3/projects/7a0ad20bf2fa40f99c433b4f20915ad5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:39.888031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f257e7409ca479c9c0140daf8d86fc3', 'request_id': 'req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.889375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57ca0-7844-4fde-97bc-357b46ab37b5 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:39.889642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57ca0-7844-4fde-97bc-357b46ab37b5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:39.889926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff57ca0-7844-4fde-97bc-357b46ab37b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:39.894584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f257e7409ca479c9c0140daf8d86fc3', 'request_id': 'req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.903850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f257e7409ca479c9c0140daf8d86fc3', 'request_id': 'req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.912237 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8ff57ca0-7844-4fde-97bc-357b46ab37b5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:39.913436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8ff57ca0-7844-4fde-97bc-357b46ab37b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.915572 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] The token cache is being invalidate because project 3f257e7409ca479c9c0140daf8d86fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:39.915888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.916518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:39.918174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 951/1920] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:39 2022] DELETE /identity/v3/projects/3f257e7409ca479c9c0140daf8d86fc3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:39.921822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:39.924083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:39.928996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:39.996553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3309c-5e53-4cc0-afc6-e2556a381cd0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:39.999091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 970/1921] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:40.005290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.006085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.006450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.006791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] PATH_INFO: `/v3/users/99b13aecb29d4698873d29cc9bce6961` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.008034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.008296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b13aecb29d4698873d29cc9bce6961)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.008388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.008583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.010565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.028916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:40.030163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.039337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 971/1922] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:40.043822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.053350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25f533-e80f-4213-8213-81bf7c848fc0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.058079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.058661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.058941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.059216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.059369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b13aecb29d4698873d29cc9bce6961'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.059861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:40.060167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.061772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.067956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b13aecb29d4698873d29cc9bce6961'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.074018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 972/1923] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:40.078279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.078430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:40.081073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b13aecb29d4698873d29cc9bce6961'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.084380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b13aecb29d4698873d29cc9bce6961'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.085974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b13aecb29d4698873d29cc9bce6961'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.089208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4351718-41ee-40b1-9684-0a7eec19c090 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.093926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.094507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.094784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.095049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.095655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.097582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.100099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 952/1924] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:39 2022] DELETE /identity/v3/users/99b13aecb29d4698873d29cc9bce6961 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:40.129031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 973/1925] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:40.130458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.131928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.211922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82842916-1b55-4b7a-b028-41a0c0702755 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.269864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.271036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.271316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.271588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.272229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.274167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.303290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 953/1926] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:40.307319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.318830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc15d1-199e-4cdc-8044-23516a376892 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.324317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.324964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.325272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.325544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.326250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.327855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.342484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 974/1927] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:40.344676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.358205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230b73-dd67-41a9-9e15-c67f80c4d611 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.369379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.370775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.371268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.371711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.372506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.375423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.389932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 954/1928] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:40.392531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.419508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c393-e115-4d50-84e7-b00dd6d43b41 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.420680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.424002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.424886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.425619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.425916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.426232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] PATH_INFO: `/v3/projects/9686d11e159f44d18beab213cfa79d8f/users/9015570b520e4a12beeba4c4007c94c6/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.442634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18c0b-2f1a-4bba-bd7e-9315fb6743b1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.450536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.451278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.451626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.451987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] PATH_INFO: `/v3/projects/f4828b64673b470f92c0d9c824d6728a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.453961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4828b64673b470f92c0d9c824d6728a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.456109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.462021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9686d11e159f44d18beab213cfa79d8f, user_id=9015570b520e4a12beeba4c4007c94c6, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.464650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5b924-bb5f-412d-b05c-77e173cbc056 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.480328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 975/1929] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:40 2022] PUT /identity/v3/projects/9686d11e159f44d18beab213cfa79d8f/users/9015570b520e4a12beeba4c4007c94c6/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:40.491388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.491670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.491945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.528089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] MFA Rules not processed for user `9015570b520e4a12beeba4c4007c94c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:40.528622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4828b64673b470f92c0d9c824d6728a', 'request_id': 'req-f07fecb3-c88e-45de-9333-e35f7225f52b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.529312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.539168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4828b64673b470f92c0d9c824d6728a', 'request_id': 'req-f07fecb3-c88e-45de-9333-e35f7225f52b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.548440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4828b64673b470f92c0d9c824d6728a', 'request_id': 'req-f07fecb3-c88e-45de-9333-e35f7225f52b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.554433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:40.564206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] The token cache is being invalidate because project f4828b64673b470f92c0d9c824d6728a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:40.564206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.564951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.567460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 955/1930] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:40 2022] DELETE /identity/v3/projects/f4828b64673b470f92c0d9c824d6728a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:40.571399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.573837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.630389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 976/1931] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:40.634745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.636459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.665731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fecb3-c88e-45de-9333-e35f7225f52b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.670888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.671980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.672586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.673106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] PATH_INFO: `/v3/users/3121e5f74fd04592b49a68a15324494e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.674447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3121e5f74fd04592b49a68a15324494e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.678027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.681302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:40.718064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed927eaf-2826-45e2-b6e4-baa32c143046 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.723504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.724643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.724917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.725184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.725801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.728178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.734563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3121e5f74fd04592b49a68a15324494e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.747951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3121e5f74fd04592b49a68a15324494e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.759332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 977/1932] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:40.762077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3121e5f74fd04592b49a68a15324494e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.762722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.762803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3121e5f74fd04592b49a68a15324494e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.763414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3121e5f74fd04592b49a68a15324494e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:40.793192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 956/1933] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:40 2022] DELETE /identity/v3/users/3121e5f74fd04592b49a68a15324494e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:40.851009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf47438-ea18-4641-ba08-4aa8807049f3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:40.934006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:40.934687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:40.935000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:40.935274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:40.936162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:40.938250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:40.965634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 978/1934] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:40 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:40.970201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:40.973464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:40.994285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa20c-d53d-43f6-82d5-771bc4845e83 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.002856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.003631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.004015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.004445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.005834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.007757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.032083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 957/1935] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:41.032593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.043554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acfedc-746e-41e0-821c-54961e13dbee admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.048543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.049232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.049512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.049783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] PATH_INFO: `/v3/projects/7f2d150efb034a3eaff3b923f8bac12b/users/8fb23b9424fe4743b0a24cde240a1ab1/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.072327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d150efb034a3eaff3b923f8bac12b, user_id=8fb23b9424fe4743b0a24cde240a1ab1, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.075314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.102084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 979/1936] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:41 2022] PUT /identity/v3/projects/7f2d150efb034a3eaff3b923f8bac12b/users/8fb23b9424fe4743b0a24cde240a1ab1/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:41.106233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.117065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b1ac-9d46-49fd-b7af-5db2960af71e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.175186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.175794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.176102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.176369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.177714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.180565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.183142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:41.195097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 958/1937] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:41.198721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.201473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.203432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.210798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0413e52-83d7-455d-9387-e22fff17d509 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.222612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.223298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.224261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.225291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] PATH_INFO: `/v3/projects/7f2d150efb034a3eaff3b923f8bac12b/users/8fb23b9424fe4743b0a24cde240a1ab1/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.227715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d150efb034a3eaff3b923f8bac12b, user_id=8fb23b9424fe4743b0a24cde240a1ab1, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.228730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8696-5f08-495b-8e91-2211338e68ad admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.231577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6298d-513c-4254-bf19-dc591a4a1e51 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.234822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.235935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.236225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.236499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] PATH_INFO: `/v3/projects/d9a4b592f6c1444db60ea44001e5c34e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.237649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a4b592f6c1444db60ea44001e5c34e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.240237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.246549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 980/1938] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:41 2022] PUT /identity/v3/projects/7f2d150efb034a3eaff3b923f8bac12b/users/8fb23b9424fe4743b0a24cde240a1ab1/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:41.258033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.258314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.258782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.291842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] MFA Rules not processed for user `8fb23b9424fe4743b0a24cde240a1ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.293071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.293983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a4b592f6c1444db60ea44001e5c34e', 'request_id': 'req-f78274fe-4cec-4615-aeb3-63438e45ee17'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.297246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:41.302511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a4b592f6c1444db60ea44001e5c34e', 'request_id': 'req-f78274fe-4cec-4615-aeb3-63438e45ee17'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.310566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a4b592f6c1444db60ea44001e5c34e', 'request_id': 'req-f78274fe-4cec-4615-aeb3-63438e45ee17'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.322212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] The token cache is being invalidate because project d9a4b592f6c1444db60ea44001e5c34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:41.322497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.323147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f78274fe-4cec-4615-aeb3-63438e45ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:41.324663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 959/1939] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:41 2022] DELETE /identity/v3/projects/d9a4b592f6c1444db60ea44001e5c34e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:41.331422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6bfa4-efac-45df-8ee6-9829f338d743 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.331708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6bfa4-efac-45df-8ee6-9829f338d743 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.331982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6bfa4-efac-45df-8ee6-9829f338d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.351692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3eb6bfa4-efac-45df-8ee6-9829f338d743 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.352886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3eb6bfa4-efac-45df-8ee6-9829f338d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.363785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 981/1940] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:41.376042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.377432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.422105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 960/1941] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:41.427603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.427963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.428213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.446458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48006d05-9bf4-40eb-8a4f-252dcca93e8c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.450679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.451519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.452014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.452598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.453666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.454897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.463067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 961/1942] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:41.467092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.467242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.468748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.478509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9d43-733c-49a5-815d-f76b67766c93 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.480177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 982/1943] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:41.485236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.485986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.486263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.486523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.487168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:41.487462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.489038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.502984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 962/1944] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:20:41.507505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.518294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaa5ef-c452-4eac-aadc-5b22f8b49d5f service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.530305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.530950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.531232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.531636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.532363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.534446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.572425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 983/1945] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:41.577495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.591209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342fd4f-61f5-43b2-8123-c248ed9aaac3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.696077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.696698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.696977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.697247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.697863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.699798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.709312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:41.725877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 963/1946] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:41.730061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.741872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26076606-c734-4780-9843-e60ba16896d3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.746961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.747582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.747940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.748207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.749233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.750811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.763367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 984/1947] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:41.767930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.781567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047167-dfc8-4579-8077-341a04658210 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.787268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.787876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.788152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.788483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.789193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.794538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482fd79-4702-4590-a35c-3427a5250135 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.813468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 964/1948] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:41.817845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:41.829235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140be9a7-feb4-4e26-901f-d5c2e9d32f77 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:41.834816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:41.835473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.835816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.836023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] PATH_INFO: `/v3/projects/83cd546ba39f4b75b858a36dafd7cf06/users/4220ee7f995d4eaeb67d9f843afdafdd/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.853765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd546ba39f4b75b858a36dafd7cf06, user_id=4220ee7f995d4eaeb67d9f843afdafdd, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:41.858100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:41.877950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 985/1949] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:41 2022] PUT /identity/v3/projects/83cd546ba39f4b75b858a36dafd7cf06/users/4220ee7f995d4eaeb67d9f843afdafdd/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:41.898195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:41.898552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:41.898995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:41.928509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] MFA Rules not processed for user `4220ee7f995d4eaeb67d9f843afdafdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:41.929801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:41.998572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.000421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.014291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 965/1950] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:42.026927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.029164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.075248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:42.101085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a707d-3a21-4b6f-9bca-751de4c076a8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.106273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd93fe-3143-400a-a29a-a36090f1e57b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.107290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.108014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.108380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.108648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] PATH_INFO: `/v3/users/9015570b520e4a12beeba4c4007c94c6` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.109808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9015570b520e4a12beeba4c4007c94c6)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.111000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.111931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.112210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.112524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.112975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.126703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.128258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aed9-b811-400f-866e-b525ad498013 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.144891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 966/1951] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:20:42.227391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9015570b520e4a12beeba4c4007c94c6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.236718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9015570b520e4a12beeba4c4007c94c6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.251066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9015570b520e4a12beeba4c4007c94c6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.259089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9015570b520e4a12beeba4c4007c94c6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.259871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9015570b520e4a12beeba4c4007c94c6'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.266051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 986/1952] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:41 2022] DELETE /identity/v3/users/9015570b520e4a12beeba4c4007c94c6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:42.271288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760773-9415-45bd-b522-4077ac04891a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.271680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760773-9415-45bd-b522-4077ac04891a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.272023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760773-9415-45bd-b522-4077ac04891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.293632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c1760773-9415-45bd-b522-4077ac04891a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:42.294979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c1760773-9415-45bd-b522-4077ac04891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.360144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 967/1953] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:42.369945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.371349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.431271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61ec4-ac66-41a6-b665-1d0663074aaa admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.434900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.435513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.435785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.436056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.446135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.447716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.457832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 987/1954] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:42.821365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760773-9415-45bd-b522-4077ac04891a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.822821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c1760773-9415-45bd-b522-4077ac04891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:42.835518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760773-9415-45bd-b522-4077ac04891a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:42.840785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:42.841609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:42.841803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:42.842103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] PATH_INFO: `/v3/projects/9686d11e159f44d18beab213cfa79d8f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:42.843237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9686d11e159f44d18beab213cfa79d8f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:42.845200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:42.854113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:42.899818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9686d11e159f44d18beab213cfa79d8f', 'request_id': 'req-6b2deab9-c50d-46c8-992c-36ebeb81d987'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.906191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9686d11e159f44d18beab213cfa79d8f', 'request_id': 'req-6b2deab9-c50d-46c8-992c-36ebeb81d987'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.914897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9686d11e159f44d18beab213cfa79d8f', 'request_id': 'req-6b2deab9-c50d-46c8-992c-36ebeb81d987'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.926920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] The token cache is being invalidate because project 9686d11e159f44d18beab213cfa79d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:42.927249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.927904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:42.929412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 968/1955] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:42 2022] DELETE /identity/v3/projects/9686d11e159f44d18beab213cfa79d8f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:42.933695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:42.944225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199457-1744-4a81-8320-89c65923d7a4 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.003198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.003859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.004127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.004532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] PATH_INFO: `/v3/users/8fb23b9424fe4743b0a24cde240a1ab1` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.006229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb23b9424fe4743b0a24cde240a1ab1)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.008522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.023291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.086250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb23b9424fe4743b0a24cde240a1ab1'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.095486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb23b9424fe4743b0a24cde240a1ab1'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.109474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb23b9424fe4743b0a24cde240a1ab1'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.118145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb23b9424fe4743b0a24cde240a1ab1'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.119069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ad7e376f-59d9-497c-8ec1-fa7c67ccd9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb23b9424fe4743b0a24cde240a1ab1'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.126099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 988/1956] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:42 2022] DELETE /identity/v3/users/8fb23b9424fe4743b0a24cde240a1ab1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:43.526502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.529334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.548373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2deab9-c50d-46c8-992c-36ebeb81d987 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.629663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.630860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.631141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.631407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] PATH_INFO: `/v3/projects/7f2d150efb034a3eaff3b923f8bac12b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.633128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2d150efb034a3eaff3b923f8bac12b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.635064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.683791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2d150efb034a3eaff3b923f8bac12b', 'request_id': 'req-82ebce98-536c-4b91-b147-8414559ea399'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.689846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2d150efb034a3eaff3b923f8bac12b', 'request_id': 'req-82ebce98-536c-4b91-b147-8414559ea399'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.697749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2d150efb034a3eaff3b923f8bac12b', 'request_id': 'req-82ebce98-536c-4b91-b147-8414559ea399'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.707741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] The token cache is being invalidate because project 7f2d150efb034a3eaff3b923f8bac12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:43.708080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.708704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-82ebce98-536c-4b91-b147-8414559ea399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:43.710212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 969/1957] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:43 2022] DELETE /identity/v3/projects/7f2d150efb034a3eaff3b923f8bac12b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:43.714948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.715229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.715498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.736384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:43.738287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.812230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 989/1958] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:43.821290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.821499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.821766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.841468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:43.842705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:43.850991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 970/1959] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:43.855194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.865145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4e83c-2477-4e81-b98b-886de1819b57 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.869765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.870402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.870677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.870945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.871588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:43.871884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.873472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.886508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 990/1960] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:43.890819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.900593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0620cd-3f2b-47f0-b00b-c84b74383e43 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:43.905178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:43.905773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:43.906082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:43.906347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:43.906958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:43.908818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:43.930589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:43.940016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 971/1961] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:43.943924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:43.954465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c020d-bd6d-4314-ac84-0ef0cd97065f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.024086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.024731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.025011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.025282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.025946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.028015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.052751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 991/1962] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:43 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:44.053708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.064016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c4c8-a4b5-4264-8065-d6875830b329 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.068625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.069212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.069486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.069747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.070410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.072056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.085298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 972/1963] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:44.086769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.093008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:44.097440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724755b8-4627-4d8b-a3bf-8924d65540f5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.115340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.115967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.116866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.117138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.117792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.119628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdeafa-16d3-4e21-a8eb-1857b756dc92 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.132455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 992/1964] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:44.136666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.160147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722bc7-6612-4b60-9902-8d8db4118a38 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.166320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.167001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.167280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.167549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] PATH_INFO: `/v3/projects/7f18628a4b7e4a7cbed4f35401912051/users/dff55a2bee654603b2d558ab07f7f424/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.183434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f18628a4b7e4a7cbed4f35401912051, user_id=dff55a2bee654603b2d558ab07f7f424, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.186098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.200330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 973/1965] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:44 2022] PUT /identity/v3/projects/7f18628a4b7e4a7cbed4f35401912051/users/dff55a2bee654603b2d558ab07f7f424/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:44.212148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.212504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.212680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.246973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] MFA Rules not processed for user `dff55a2bee654603b2d558ab07f7f424`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:44.248426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.365500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 993/1966] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:44.373261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:44.375122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:44.438285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b1064-f33c-4ccf-b91d-3340d4cbca81 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:44.442098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:44.442603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:44.442879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:44.443148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:44.451695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:44.453115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fadda-d466-4698-ba93-625e96e995b2 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:44.462285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 974/1967] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:47.382284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.384673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.449676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b3700-2dcb-4c6f-b891-30b9a423ac86 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.454245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.454873 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.455146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.455410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] PATH_INFO: `/v3/users/bd4b405c2fa04e8793f2e6f55f54247f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.456532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4b405c2fa04e8793f2e6f55f54247f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.458638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.513589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4b405c2fa04e8793f2e6f55f54247f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.524502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4b405c2fa04e8793f2e6f55f54247f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.538837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4b405c2fa04e8793f2e6f55f54247f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.545834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4b405c2fa04e8793f2e6f55f54247f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.546662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4b405c2fa04e8793f2e6f55f54247f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.552722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 994/1968] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:47 2022] DELETE /identity/v3/users/bd4b405c2fa04e8793f2e6f55f54247f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:47.557088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.557602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.557695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.576310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:47.577496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.638258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 975/1969] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:47.648807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.650217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.655525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:47.707471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3d6a1-1944-457c-9ca9-a889aeb3825f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.711576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.712171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.712450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.712710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.722013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.724178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b512af8-2d88-4dc3-830a-3fdc2118a89b service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.733974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 995/1970] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:47.736451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.737837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.749733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb2d05-3045-4760-a3a1-d401cfad7943 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:47.754347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:47.754981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.755257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.755523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] PATH_INFO: `/v3/users/dff55a2bee654603b2d558ab07f7f424` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.756649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff55a2bee654603b2d558ab07f7f424)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:47.758594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:47.806940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff55a2bee654603b2d558ab07f7f424'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.815414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff55a2bee654603b2d558ab07f7f424'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.821957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:47.839233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff55a2bee654603b2d558ab07f7f424'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.841156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff55a2bee654603b2d558ab07f7f424'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.842240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff55a2bee654603b2d558ab07f7f424'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:47.858836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 976/1971] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:47 2022] DELETE /identity/v3/users/dff55a2bee654603b2d558ab07f7f424 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:47.863338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:47.863703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:47.864117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:47.917648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:47.919124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:47.982853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 996/1972] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:47.993126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:47.994692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.062541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214e77-b5ed-4739-817a-b4933fc0ca88 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.066181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.066836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.067142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.067424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.077378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.078832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.089785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 977/1973] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:48.125529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.127338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.143627 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac89d4-387c-47b4-9105-b5c966018992 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.150143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.150778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.151222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.151410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] PATH_INFO: `/v3/projects/a22075e1a1aa45f28adbafc0f0850149` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.152945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22075e1a1aa45f28adbafc0f0850149)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.155841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.230356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22075e1a1aa45f28adbafc0f0850149', 'request_id': 'req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.261783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22075e1a1aa45f28adbafc0f0850149', 'request_id': 'req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.272993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22075e1a1aa45f28adbafc0f0850149', 'request_id': 'req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.284468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] The token cache is being invalidate because project a22075e1a1aa45f28adbafc0f0850149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:48.284759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.285542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.289593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 997/1974] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:48 2022] DELETE /identity/v3/projects/a22075e1a1aa45f28adbafc0f0850149 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:48.293393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.307567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe85a2-00f3-4c98-9788-733e5136dfe3 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.385417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.386240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.386590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.387109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] PATH_INFO: `/v3/users/6305fdb5bca2442f8dd47bb69298a547` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.388517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6305fdb5bca2442f8dd47bb69298a547)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.390720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.449480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6305fdb5bca2442f8dd47bb69298a547'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.459203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6305fdb5bca2442f8dd47bb69298a547'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.472066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6305fdb5bca2442f8dd47bb69298a547'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.473126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6305fdb5bca2442f8dd47bb69298a547'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.473762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-15a4e081-5118-4a2e-9d0e-c0128c9d4e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6305fdb5bca2442f8dd47bb69298a547'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.482544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:48.487221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 978/1975] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:20:48 2022] DELETE /identity/v3/users/6305fdb5bca2442f8dd47bb69298a547 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:48.527911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.529342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.544878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4b3a3-d2e2-4e9d-ab7a-c6e3b95c98c7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.581175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:48.617252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.617252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.617252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.617252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] PATH_INFO: `/v3/projects/7f18628a4b7e4a7cbed4f35401912051` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.618475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f18628a4b7e4a7cbed4f35401912051)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.620118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.690501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f18628a4b7e4a7cbed4f35401912051', 'request_id': 'req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.700773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f18628a4b7e4a7cbed4f35401912051', 'request_id': 'req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.709075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f18628a4b7e4a7cbed4f35401912051', 'request_id': 'req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.752657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] The token cache is being invalidate because project 7f18628a4b7e4a7cbed4f35401912051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:48.752966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.753753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.756119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 998/1976] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:48 2022] DELETE /identity/v3/projects/7f18628a4b7e4a7cbed4f35401912051 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:48.761296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258427-077f-4946-9f97-eae683fcd64b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.761852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258427-077f-4946-9f97-eae683fcd64b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.761852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258427-077f-4946-9f97-eae683fcd64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.783881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a0258427-077f-4946-9f97-eae683fcd64b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:48.785269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a0258427-077f-4946-9f97-eae683fcd64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.808720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.810623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.904668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 979/1977] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:48.912764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.913074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.913368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.919079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1ab80-e84d-4f43-be6c-e540bc1cebab admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.925192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.925829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.926143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.926504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] PATH_INFO: `/v3/projects/f8731a9a942849a8afb12e4af326af27` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.927608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8731a9a942849a8afb12e4af326af27)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.929538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.933828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:48.935239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:48.944068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 980/1978] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:48.950887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:48.960871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b387-4a05-4fd3-ade2-adfbee12300d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:48.967905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:48.968602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:48.969097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:48.969379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:48.970583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:48.970705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:48.972231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:48.984677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8731a9a942849a8afb12e4af326af27', 'request_id': 'req-329b23d6-735b-4afd-a455-31647eb7600a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:48.985327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 981/1979] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:48.990530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.001635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc57805-3c5f-42c7-820f-92591447f5ef admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.010486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8731a9a942849a8afb12e4af326af27', 'request_id': 'req-329b23d6-735b-4afd-a455-31647eb7600a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:49.023004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8731a9a942849a8afb12e4af326af27', 'request_id': 'req-329b23d6-735b-4afd-a455-31647eb7600a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:49.024928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:49.043751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] The token cache is being invalidate because project f8731a9a942849a8afb12e4af326af27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:20:49.044488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:49.045246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-329b23d6-735b-4afd-a455-31647eb7600a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:20:49.046992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 999/1980] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:20:48 2022] DELETE /identity/v3/projects/f8731a9a942849a8afb12e4af326af27 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:49.053939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135663-e89e-49d0-99b8-69cfca2a59a2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.054213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135663-e89e-49d0-99b8-69cfca2a59a2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.054529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135663-e89e-49d0-99b8-69cfca2a59a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.075433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7b135663-e89e-49d0-99b8-69cfca2a59a2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:49.076633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7b135663-e89e-49d0-99b8-69cfca2a59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:49.085829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.086482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.086926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.087212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.088277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.090706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.150949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 982/1981] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:48 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:49.154937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.158414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:49.170265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1000/1982] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:49.179130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.179414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.179690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.228002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:49.231908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:49.282451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90cbad-5a6b-430d-be82-8e26a0ca1628 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.294944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.297456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.297892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.298192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.299372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.304818 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.333443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:49.359208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 983/1983] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:49.362958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.377991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda84-a675-49da-8808-88a081986d45 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.394666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.395766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.396278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.397660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.401519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.406260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1001/1984] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:20:49.407274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.408735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.422134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 984/1985] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:20:49.425283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.450822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca4b62-4202-4d5c-8056-1406cb4b9dfa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.459675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6d62e-68d4-4348-b7cc-5945922e1947 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.465224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.465960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.466304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.466645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.467119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.467464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.467875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.468223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.468567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.469469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.470243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:20:49.470633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.478178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.485236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 985/1986] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:49.490026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.503512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5493207-90ac-4906-8479-4b85ac041758 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.510203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.511585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.513120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.513591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] PATH_INFO: `/v3/projects/a9081328312d42db9abf7bb5425efdff/users/cb5d016be8cc42fda33535749b5778f7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.523958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1002/1987] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:20:49.528283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.541117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538c672-b175-4ab2-929a-94c72e320fee admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.546558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.547225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.547505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.548032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.548821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.551014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9081328312d42db9abf7bb5425efdff, user_id=cb5d016be8cc42fda33535749b5778f7, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.551905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.557118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36478e12-c399-4014-bd5d-7b18b232b3b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.588722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 986/1988] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:49 2022] PUT /identity/v3/projects/a9081328312d42db9abf7bb5425efdff/users/cb5d016be8cc42fda33535749b5778f7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:49.600423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.600712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.601002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.603419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1003/1989] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:20:49.607815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.647653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] MFA Rules not processed for user `cb5d016be8cc42fda33535749b5778f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:49.648872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:49.699844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:49.709646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbb37c-371d-4d4b-bc83-9bbce80c3863 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.717347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.718197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.718548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.719603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.719724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.722586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.728536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 987/1990] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:49.748003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.749437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:49.772741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1004/1991] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:49.773953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.808207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3ec-e122-49ac-85e4-3e631e806f17 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.814876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.817646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.817981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.818432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.819295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.821191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.840896 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1005/1992] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:49.842088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.846193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5a04-affb-4aea-a048-001c2ff4be4f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.851959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.852791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.853268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.854327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.857477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6faac2-eae4-4f6f-b216-3c9caa89ed0b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.868020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.868410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.869322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.869706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.870146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.871391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.871669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf4534-8bb1-47d3-a634-662a4966369b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.873346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.891894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1006/1993] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:49.907724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 988/1994] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:49.909878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:49.922313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee1d4-b891-4557-b070-a857a2bc1746 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:49.930323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:49.931149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.931526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.931941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] PATH_INFO: `/v3/projects/bf6f1f0289954ea587a1df441ca423e1/users/08dfc49ba93640e5a4e616d74b0a8642/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:49.950054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6f1f0289954ea587a1df441ca423e1, user_id=08dfc49ba93640e5a4e616d74b0a8642, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:49.953235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:49.979503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1007/1995] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:49 2022] PUT /identity/v3/projects/bf6f1f0289954ea587a1df441ca423e1/users/08dfc49ba93640e5a4e616d74b0a8642/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:49.986651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:49.986933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:49.987204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.028965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] MFA Rules not processed for user `08dfc49ba93640e5a4e616d74b0a8642`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:50.030464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:50.088286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:50.167189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 989/1996] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:50.171800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.314652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04109dc7-cb2c-4ac2-bcd9-a9d96c13dc29 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.335316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.336072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.336378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.336722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.337494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.339668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.396477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1008/1997] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:50.397710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.447474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf5c4-11bc-4fb1-a36b-8a8d4015e05e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.532251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.533059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.533266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.533555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.534229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.536315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.563910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 990/1998] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:20:50 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:20:50.568018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.578733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b93a07-5c2b-4ac3-a7b1-7c2e16a921ec admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.585236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.585737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.586206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.586452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.587482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.588910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.606294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1009/1999] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:50.610811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.624345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353a8e1-b564-4bf8-be20-9b703cb7d95d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.631360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.632099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.632441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.632730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] PATH_INFO: `/v3/projects/592a6c9949fa4715a3030852e82b0864/users/7952e68f65504aada1fc0637086dacdd/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.651002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] RBAC: Authorizing `identity:create_grant(project_id=592a6c9949fa4715a3030852e82b0864, user_id=7952e68f65504aada1fc0637086dacdd, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.654075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.686586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 991/2000] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:50 2022] PUT /identity/v3/projects/592a6c9949fa4715a3030852e82b0864/users/7952e68f65504aada1fc0637086dacdd/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:20:50.688713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.706532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbc0fe-6fa9-475a-887d-3ee2955198cf admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.818443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.819713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.819999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.820268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.820927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.822626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9458-9cf9-4135-908a-521bd82888d4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.848777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1010/2001] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:20:50.851109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:50.861446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b041f-1dc4-4fe7-b531-f179e22e585b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:50.866728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:50.867448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.867726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.868000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] PATH_INFO: `/v3/projects/592a6c9949fa4715a3030852e82b0864/users/7952e68f65504aada1fc0637086dacdd/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.870071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592a6c9949fa4715a3030852e82b0864, user_id=7952e68f65504aada1fc0637086dacdd, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:50.874106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:50.889576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 992/2002] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:20:50 2022] PUT /identity/v3/projects/592a6c9949fa4715a3030852e82b0864/users/7952e68f65504aada1fc0637086dacdd/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:20:50.897590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:50.898059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:50.898347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:50.920832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:20:50.932682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] MFA Rules not processed for user `7952e68f65504aada1fc0637086dacdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:20:50.932889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:51.023529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1011/2003] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:20:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:20:51.043397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:51.155940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3ef42-d363-4d85-b06b-393a9a450d99 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:51.159986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:51.160598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:51.161405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:51.161670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:51.171408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:51.172835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:51.184805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 993/2004] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:20:51.321976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:20:51.328566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:20:51.369758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21002-9d1a-4546-8647-bd6d9791e482 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:20:51.373746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:20:51.374293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:20:51.374635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:20:51.374971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:20:51.440199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:20:51.441649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cf559-e617-4608-b27e-06781ca852bf service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:20:51.451342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1012/2005] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:20:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:01.179754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:01.446748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=58 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:37.410888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.477193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a1f1-ee6e-492c-ac02-e6181d48ce01 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.481870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.482618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.482893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.483162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] PATH_INFO: `/v3/users/08dfc49ba93640e5a4e616d74b0a8642` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.484275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08dfc49ba93640e5a4e616d74b0a8642)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.486211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.536070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08dfc49ba93640e5a4e616d74b0a8642'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.544331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08dfc49ba93640e5a4e616d74b0a8642'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.556808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08dfc49ba93640e5a4e616d74b0a8642'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.557470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08dfc49ba93640e5a4e616d74b0a8642'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.558097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08dfc49ba93640e5a4e616d74b0a8642'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:37.570066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 994/2006] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:37 2022] DELETE /identity/v3/users/08dfc49ba93640e5a4e616d74b0a8642 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:37.574637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.575158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.575158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.595009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:37.596732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.668096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1013/2007] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:37.679174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:37.680800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:37.739660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeecc7b-69f0-4f17-b6ab-e40e21132e42 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:37.743182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:37.743784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:37.744058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:37.744322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:37.756732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:37.758279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:37.768809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 995/2008] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:38.044302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:38.045845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:38.060470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c131-de03-4348-b7ba-1ce4d4419bad None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:38.065224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:38.066020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.066394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.066783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] PATH_INFO: `/v3/projects/bf6f1f0289954ea587a1df441ca423e1` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.069104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6f1f0289954ea587a1df441ca423e1)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:38.071705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:38.118402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6f1f0289954ea587a1df441ca423e1', 'request_id': 'req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.126625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6f1f0289954ea587a1df441ca423e1', 'request_id': 'req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.133562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6f1f0289954ea587a1df441ca423e1', 'request_id': 'req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.145600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] The token cache is being invalidate because project bf6f1f0289954ea587a1df441ca423e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:38.145992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.146695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.148248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1014/2009] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:38 2022] DELETE /identity/v3/projects/bf6f1f0289954ea587a1df441ca423e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:38.152219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:38.161964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262b04-14f7-4966-a735-3e535ab80b1c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:38.180991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:38.222645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:38.223328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.223601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.223869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] PATH_INFO: `/v3/users/7952e68f65504aada1fc0637086dacdd` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.225010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7952e68f65504aada1fc0637086dacdd)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:38.227211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:38.277996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7952e68f65504aada1fc0637086dacdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.285863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7952e68f65504aada1fc0637086dacdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.299123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7952e68f65504aada1fc0637086dacdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.300411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7952e68f65504aada1fc0637086dacdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.301076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21e5f861-118e-4cbe-92a7-65bd627098d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7952e68f65504aada1fc0637086dacdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.314444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 996/2010] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:38 2022] DELETE /identity/v3/users/7952e68f65504aada1fc0637086dacdd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:38.721751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:38.727251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:38.743019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2a662-5053-4c17-8ad3-5d2b30d9abae admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:38.818991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:38.819533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.819810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.820192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] PATH_INFO: `/v3/projects/592a6c9949fa4715a3030852e82b0864` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.821234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592a6c9949fa4715a3030852e82b0864)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:38.823221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:38.853666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:38.871932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592a6c9949fa4715a3030852e82b0864', 'request_id': 'req-dd406cd0-a2a3-41f7-8137-d9a37d638067'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.883143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592a6c9949fa4715a3030852e82b0864', 'request_id': 'req-dd406cd0-a2a3-41f7-8137-d9a37d638067'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.890458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592a6c9949fa4715a3030852e82b0864', 'request_id': 'req-dd406cd0-a2a3-41f7-8137-d9a37d638067'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.903179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] The token cache is being invalidate because project 592a6c9949fa4715a3030852e82b0864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:38.903437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.904018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-dd406cd0-a2a3-41f7-8137-d9a37d638067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:38.905502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1015/2011] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:38 2022] DELETE /identity/v3/projects/592a6c9949fa4715a3030852e82b0864 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:38.910796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:38.911262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:38.911479 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:38.931725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:38.933012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:38.993861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 997/2012] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:39.001697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.002262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.002542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.022369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:39.023565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:39.031451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1016/2013] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:39.036197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.045569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d940dd-4484-4e24-ac7d-805f250c2b97 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.050757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.051352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.051653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.051921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.052561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:39.052863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.054491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.067609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 998/2014] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:39.071777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.083060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a67bc-2d84-4021-9f71-d36d29564277 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.087905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.088506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.088775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.089547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.089675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.091574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.126301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1017/2015] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:39.130104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.141090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f93ca-b6a8-4496-a4d5-0749f1c5ebd5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.172250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:39.210324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.211267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.211700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.212043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.212787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.214813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.240443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 999/2016] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:39.244508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.255041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641af0-2337-45ad-885f-02d8553c6fa1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.259728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.260343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.260638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.260904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.261542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.263187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.274435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1018/2017] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:39.278455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.288913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292de08-d3d9-43b4-82d3-2077aeb71301 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.294092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.294717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.294992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.295257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.295883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.297460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da854f95-faea-4b30-a2da-632982dd4bd6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.307913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1000/2018] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:39.312048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.322257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3a155-82be-4860-81d0-5845626f114c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.326784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.327438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.327715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.327987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] PATH_INFO: `/v3/projects/912f65bb682e4612a7e3047cbc6f2aeb/users/3a5175d2d026443f917e48a5122c2a86/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.343930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912f65bb682e4612a7e3047cbc6f2aeb, user_id=3a5175d2d026443f917e48a5122c2a86, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.347054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.363342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1019/2019] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:39 2022] PUT /identity/v3/projects/912f65bb682e4612a7e3047cbc6f2aeb/users/3a5175d2d026443f917e48a5122c2a86/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:39.375335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.375665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.375922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.405955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] MFA Rules not processed for user `3a5175d2d026443f917e48a5122c2a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:39.407177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:39.475002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1001/2020] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:39.479462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.542427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3b2e-913a-462b-9c1b-26e308cea9b4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.547196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.547802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.548081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.548353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.549089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.551574 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.580368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1020/2021] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:39.584483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.595734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3b145-dfb7-4a86-89c8-7f1489ed55b0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.654075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.654808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.655086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.655356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.655980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.657888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.682907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1002/2022] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:39.686926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.700540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5d830-8e48-4743-9b7a-a6b6c666967c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.705332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.706111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.706414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.706688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.707393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.708991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.725334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1021/2023] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:39.727001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.739042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f14b-fbd7-41d4-9de5-ae9b38e884ed admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.744156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.744814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.745090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.745361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] PATH_INFO: `/v3/projects/6d551b69d9bd4ae69de4d2831f52192c/users/78ff39b2fff14f73b495e71ab1336c5b/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.762295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d551b69d9bd4ae69de4d2831f52192c, user_id=78ff39b2fff14f73b495e71ab1336c5b, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.764971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.788663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1003/2024] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:39 2022] PUT /identity/v3/projects/6d551b69d9bd4ae69de4d2831f52192c/users/78ff39b2fff14f73b495e71ab1336c5b/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:39.789745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.800726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd676ea-73f1-42e6-948f-7d3377736c32 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.823522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:39.864385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.865102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.865466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.865806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.866540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.868193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5351-55cf-444e-851d-26f483ea885a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.878724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1022/2025] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:39.883018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:39.888566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:39.896403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6e48b-a5a3-4871-b31f-fb2edb98057d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:39.901386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:39.902099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.902379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.902653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] PATH_INFO: `/v3/projects/6d551b69d9bd4ae69de4d2831f52192c/users/78ff39b2fff14f73b495e71ab1336c5b/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.904541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d551b69d9bd4ae69de4d2831f52192c, user_id=78ff39b2fff14f73b495e71ab1336c5b, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:39.907190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:39.917322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1004/2026] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:39 2022] PUT /identity/v3/projects/6d551b69d9bd4ae69de4d2831f52192c/users/78ff39b2fff14f73b495e71ab1336c5b/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:39.927598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:39.927885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:39.928157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:39.956144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] MFA Rules not processed for user `78ff39b2fff14f73b495e71ab1336c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:39.957340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:40.025084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1023/2027] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:40.036613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:40.038472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:40.097219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c9576-3d4d-4756-9852-28d151abff58 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:40.100901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:40.101499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:40.101781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:40.102092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:40.156747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:40.158205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:40.168984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1005/2028] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:48.861032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:48.872178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec0e0-8cbe-4d0b-9897-1302cdc1c6b7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:48.877345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:48.878071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:48.878348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:48.878621 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:48.896317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:48.898017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b924-a150-496e-9f3d-32a034e147be service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:48.912768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1024/2029] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:50.164301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:51.931419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:51.932969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.001171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa39c7c-4896-4dab-b29c-e4573a4f41a9 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.006176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.006797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.007073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.007335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] PATH_INFO: `/v3/users/cb5d016be8cc42fda33535749b5778f7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.008487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5d016be8cc42fda33535749b5778f7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.010437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.060223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5d016be8cc42fda33535749b5778f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.069027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5d016be8cc42fda33535749b5778f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.081774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5d016be8cc42fda33535749b5778f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.082581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5d016be8cc42fda33535749b5778f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.083259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5d016be8cc42fda33535749b5778f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.095889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1006/2030] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:51 2022] DELETE /identity/v3/users/cb5d016be8cc42fda33535749b5778f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:52.100383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.100855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.100955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.120352 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:52.121584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.187523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1025/2031] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:52.198402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.199836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.266216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d9b7-c606-4b0a-a418-bb4bd858c16e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.270579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.271259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.271535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.271800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.281298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.282855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174cd99-95f6-4a03-b31c-433fc8dd8c00 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.293800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1007/2032] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:52.604806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.606434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.622978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876031e-d212-416b-9adb-2f561f932f85 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.629230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.630491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.630804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.631154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] PATH_INFO: `/v3/projects/a9081328312d42db9abf7bb5425efdff` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.632357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9081328312d42db9abf7bb5425efdff)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.635140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.682624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:52.699695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9081328312d42db9abf7bb5425efdff', 'request_id': 'req-c47accc0-91f8-46c7-bf1a-19dce2cec81c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.708100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9081328312d42db9abf7bb5425efdff', 'request_id': 'req-c47accc0-91f8-46c7-bf1a-19dce2cec81c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.714851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9081328312d42db9abf7bb5425efdff', 'request_id': 'req-c47accc0-91f8-46c7-bf1a-19dce2cec81c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.725550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] The token cache is being invalidate because project a9081328312d42db9abf7bb5425efdff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:52.725832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.726684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c47accc0-91f8-46c7-bf1a-19dce2cec81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:52.734076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1026/2033] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:52 2022] DELETE /identity/v3/projects/a9081328312d42db9abf7bb5425efdff => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:52.735529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.735813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.736652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.757352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:52.758749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.776214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:52.820383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1008/2034] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:52.828044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.828342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.828619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.849082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:52.850317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:52.858448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1027/2035] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:52.863420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.874309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6daf4e-a701-4d86-a1f9-267e4a679f69 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.884307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.884976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.885259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.885640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.886438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:52.886834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.900219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.913532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1009/2036] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:52.918251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.929332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046278d-d8ad-40db-a42d-0f31f974a7f2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:52.933287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:52.933880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:52.934180 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:52.934446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:52.935061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:52.936940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:52.965350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1028/2037] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:52.969629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:52.979995 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2927f9-e39d-47e6-a769-dcf8772f7efa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.037680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.038336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.038613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.038882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.039505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.041434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.062786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1010/2038] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:52 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:53.067352 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.077538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f599af7-991f-4c9d-9ac2-ef02f8c73945 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.082142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.082707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.082975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.083238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.083863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.085551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.096523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1029/2039] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:53.100641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.110471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc5c7-e42a-4a48-acb4-64b08e3d2b0e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.115666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.116257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.116531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.116802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.117432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.119123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46887f49-a689-447b-8bf4-8bb3b0d7320e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.129989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1011/2040] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:53.134326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.144460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f975-a9d0-4403-8ab5-838e97ba08fb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.149085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.149723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.150026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.150292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] PATH_INFO: `/v3/projects/626bd922b6fc4105b1f8acf49b691f53/users/6ffd6f0d01364b5c9d9be5072e38fe0c/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.168958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626bd922b6fc4105b1f8acf49b691f53, user_id=6ffd6f0d01364b5c9d9be5072e38fe0c, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.170918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.186958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1030/2041] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:53 2022] PUT /identity/v3/projects/626bd922b6fc4105b1f8acf49b691f53/users/6ffd6f0d01364b5c9d9be5072e38fe0c/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:53.192062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.192643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.192987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.214052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:53.215252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.289264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1012/2042] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:53.298885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.300640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.367810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3b53b-68c5-4126-8c33-90e6678b8c23 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.371420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.372025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.372300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.372554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.381711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.383181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dfd74-81d0-46ad-a54b-adf8d2b348e7 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:53.394360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1031/2043] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:21:53.959225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:53.960687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:53.973794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecc0bd-adf9-4b9c-9767-c9c2edc7ef01 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:53.979304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:53.979919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:53.980192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:53.980459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] PATH_INFO: `/v3/users/4220ee7f995d4eaeb67d9f843afdafdd` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:53.981725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4220ee7f995d4eaeb67d9f843afdafdd)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:53.984088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:54.016830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:54.050874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4220ee7f995d4eaeb67d9f843afdafdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.060162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4220ee7f995d4eaeb67d9f843afdafdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.075210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4220ee7f995d4eaeb67d9f843afdafdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.076088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4220ee7f995d4eaeb67d9f843afdafdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.076694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4220ee7f995d4eaeb67d9f843afdafdd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:54.108963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1013/2044] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:53 2022] DELETE /identity/v3/users/4220ee7f995d4eaeb67d9f843afdafdd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:54.113671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.113976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.114436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.147212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:54.149618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:54.222264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:54.249852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1032/2045] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:54.260921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:54.262910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:54.373886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baff53-7cd3-4ebf-96b4-ca88bda258db admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:54.379678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:54.381388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:54.381827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:54.382631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:54.403134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:54.406425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96981a-d54d-4955-8d58-674111183778 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:54.420520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1014/2046] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:55.009432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.010946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.024331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7cdd3-7bb8-4691-aab3-77c7801439a2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.029372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.030431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.030431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.030722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] PATH_INFO: `/v3/projects/83cd546ba39f4b75b858a36dafd7cf06` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.032042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cd546ba39f4b75b858a36dafd7cf06)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.034011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.091471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cd546ba39f4b75b858a36dafd7cf06', 'request_id': 'req-824729dd-37ae-47fc-9e18-1b879659eb78'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:55.102652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cd546ba39f4b75b858a36dafd7cf06', 'request_id': 'req-824729dd-37ae-47fc-9e18-1b879659eb78'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:55.110785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cd546ba39f4b75b858a36dafd7cf06', 'request_id': 'req-824729dd-37ae-47fc-9e18-1b879659eb78'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:55.125558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] The token cache is being invalidate because project 83cd546ba39f4b75b858a36dafd7cf06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:55.125858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:55.126548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-824729dd-37ae-47fc-9e18-1b879659eb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:55.130411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1033/2047] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:55 2022] DELETE /identity/v3/projects/83cd546ba39f4b75b858a36dafd7cf06 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:55.134404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.134908 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.135023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.154359 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:55.155597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.233239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1015/2048] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:55.241009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.241462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.241540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.262115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:55.263731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.272841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1034/2049] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:55.277998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.290736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471f74-8286-48cd-959f-1542950f0f1d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.296029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.296735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.297134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.297452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.298368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:55.298801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.300587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.314661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1016/2050] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:55.320104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.330826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248324e-1a4e-48bc-84bc-e3e67b0612bc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.336897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.337516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.338023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.338321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.338973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.340871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.387678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1035/2051] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:55.393169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.424346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c675b-9b35-4a32-b9c1-edcc090cecfb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.466592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:55.505675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.507402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.507852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.508271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.509058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.511167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.535746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1017/2052] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:55.539968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.550545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3076c-398e-40af-8a5b-c7e0e6f93a83 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.555247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.555850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.556126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.556400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.557036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.558696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.572482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1036/2053] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:21:55.573741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.585476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3646f-7f13-4bc2-bc7f-95da6c0375fd admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.590273 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.590883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.591162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.591433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.592085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.593655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0597e-b8ab-48e3-b3ca-a835b93aded8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.603999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1018/2054] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:55.608266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.618567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb235-32bf-45a3-a66a-fca6ac770cec admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.623655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.624311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.624638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.624892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] PATH_INFO: `/v3/projects/53cdd3531d144288ad7687e123bd97bf/users/f8d50a4d18174641a4f737ecb3d68893/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.641120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cdd3531d144288ad7687e123bd97bf, user_id=f8d50a4d18174641a4f737ecb3d68893, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.644796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.659460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1037/2055] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:55 2022] PUT /identity/v3/projects/53cdd3531d144288ad7687e123bd97bf/users/f8d50a4d18174641a4f737ecb3d68893/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:55.670398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.670772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.671281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.703356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] MFA Rules not processed for user `f8d50a4d18174641a4f737ecb3d68893`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:55.704568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.786244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1019/2056] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:55.797773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.800246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:55.899912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1410-88fc-43c8-b95d-06a6790e1bb4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:55.904664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:55.905477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:55.905849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:55.906248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:55.922110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:55.924101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cb89f-7a75-4046-86d3-955372f80266 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:55.940734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1038/2057] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:55.994586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:55.996463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:56.131289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814efd40-d159-4daa-b192-5879b2983c17 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:56.136302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:56.137070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:56.137354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:56.137628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] PATH_INFO: `/v3/users/3a5175d2d026443f917e48a5122c2a86` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:56.139923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5175d2d026443f917e48a5122c2a86)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:56.141871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:56.211664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:56.223358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5175d2d026443f917e48a5122c2a86'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:56.234412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5175d2d026443f917e48a5122c2a86'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:56.252563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5175d2d026443f917e48a5122c2a86'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:56.253524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5175d2d026443f917e48a5122c2a86'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:56.254727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5175d2d026443f917e48a5122c2a86'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:56.278311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1020/2058] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:55 2022] DELETE /identity/v3/users/3a5175d2d026443f917e48a5122c2a86 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:56.283502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:56.283963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:56.284054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:56.313257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:56.315657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:56.331235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:56.459910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1039/2059] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:56.471394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:56.473272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:56.571489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd0ef5-c282-43f1-86bb-7fbcf95d6d9a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:56.576487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:56.577061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:56.577341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:56.577608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:56.589719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:56.591458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:56.609523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1021/2060] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:21:57.056976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:57.059586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:57.088720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb44d-ad15-4931-93bb-c68f38c85b05 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:57.094371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:57.095018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:57.095895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:57.096622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] PATH_INFO: `/v3/projects/912f65bb682e4612a7e3047cbc6f2aeb` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:57.097805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912f65bb682e4612a7e3047cbc6f2aeb)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:57.100305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:57.197608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912f65bb682e4612a7e3047cbc6f2aeb', 'request_id': 'req-c7c97796-5782-4723-b93c-e2da0799cb29'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.207656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912f65bb682e4612a7e3047cbc6f2aeb', 'request_id': 'req-c7c97796-5782-4723-b93c-e2da0799cb29'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.220695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912f65bb682e4612a7e3047cbc6f2aeb', 'request_id': 'req-c7c97796-5782-4723-b93c-e2da0799cb29'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.234136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] The token cache is being invalidate because project 912f65bb682e4612a7e3047cbc6f2aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:57.234431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.235410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.241634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1040/2061] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:57 2022] DELETE /identity/v3/projects/912f65bb682e4612a7e3047cbc6f2aeb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:57.245530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:57.256491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cce46-b3c1-4a04-bbb3-9e496d92bc93 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:57.354385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:57.355083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:57.355366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:57.355776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] PATH_INFO: `/v3/users/78ff39b2fff14f73b495e71ab1336c5b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:57.357553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ff39b2fff14f73b495e71ab1336c5b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:57.375869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:57.453357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ff39b2fff14f73b495e71ab1336c5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.466637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ff39b2fff14f73b495e71ab1336c5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.478473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:57.486415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ff39b2fff14f73b495e71ab1336c5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.487420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ff39b2fff14f73b495e71ab1336c5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.488295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c816482d-c7ff-4b08-969f-d81f6d713e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ff39b2fff14f73b495e71ab1336c5b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:57.526848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1022/2062] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:21:57 2022] DELETE /identity/v3/users/78ff39b2fff14f73b495e71ab1336c5b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:58.036309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.037726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:58.065320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97796-5782-4723-b93c-e2da0799cb29 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.143659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.144553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.144835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.145107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] PATH_INFO: `/v3/projects/6d551b69d9bd4ae69de4d2831f52192c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.146281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d551b69d9bd4ae69de4d2831f52192c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.148416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.202169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:58.207979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d551b69d9bd4ae69de4d2831f52192c', 'request_id': 'req-e39b8243-1313-465d-bad9-9e7d06d774f7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.219037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d551b69d9bd4ae69de4d2831f52192c', 'request_id': 'req-e39b8243-1313-465d-bad9-9e7d06d774f7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.226764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d551b69d9bd4ae69de4d2831f52192c', 'request_id': 'req-e39b8243-1313-465d-bad9-9e7d06d774f7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.239508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] The token cache is being invalidate because project 6d551b69d9bd4ae69de4d2831f52192c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:21:58.239702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.240347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-e39b8243-1313-465d-bad9-9e7d06d774f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:21:58.247086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1041/2063] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:21:58 2022] DELETE /identity/v3/projects/6d551b69d9bd4ae69de4d2831f52192c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:58.248686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.249137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.249215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.273788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:58.275109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:58.350054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1023/2064] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:21:58.356626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.356899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.357168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.379366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:58.380560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:58.393053 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1042/2065] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:58.397443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.411397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4a7b-5442-48a4-b8d3-075dba5a5847 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.415875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.416660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.417784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.417784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.418161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:21:58.418404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.420106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.441486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1024/2066] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:21:58.443099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.454145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c84d04-f459-473c-93a4-9741ede5d532 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.460588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.461207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.461499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.461958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.462732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.464665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.523353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.524268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1043/2067] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:58.535483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480542-ade9-4364-adf9-6273264e182c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.660468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.661369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.661819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.662122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.662805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.669296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.739387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.751585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1025/2068] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:58.754490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6ec51-50ac-4e89-a85d-735bc4df5240 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.760381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.761301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.761661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.761834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.762756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.764742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.780425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1044/2069] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:58.784198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.797092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5b7d4-c36d-4ffd-8d94-d332639d1d7d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.803471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.804092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.804369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.804634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.805333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.808331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89942b10-dcac-4bb9-8436-289456769e5c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.822560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1026/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:58.826844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:58.837726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ead0-d664-4c97-ab10-d9c46a797a49 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:58.849426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:58.850158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.850503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.850839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] PATH_INFO: `/v3/projects/add3369ff549477aadcfc34e6973ac26/users/123f284450a64aaaa1d79a99ef3ad8ae/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:58.907563 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] RBAC: Authorizing `identity:create_grant(project_id=add3369ff549477aadcfc34e6973ac26, user_id=123f284450a64aaaa1d79a99ef3ad8ae, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:58.919308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:58.945259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1045/2071] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:58 2022] PUT /identity/v3/projects/add3369ff549477aadcfc34e6973ac26/users/123f284450a64aaaa1d79a99ef3ad8ae/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:21:58.962204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:58.962795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:58.962795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.015665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] MFA Rules not processed for user `123f284450a64aaaa1d79a99ef3ad8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:59.016801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.060133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:59.103269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1027/2072] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.108070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.186784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6ee9-2cce-4c78-95dd-19959927baca admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.196939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.198103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.198475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.198876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.199504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.201934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.249298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1046/2073] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:59.250662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.264463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05c09f-d5a7-4fd5-8361-5ececf0e935f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.331933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.332624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.332905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.333198 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.333957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.335904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d49def-7143-41c4-9177-275a2f659fe5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.360118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1028/2074] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:59.364838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.375891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8303-4b9d-4b9e-8d6c-f266f2ca440c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.400707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.401671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.402239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.402518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.403242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.405026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.421787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.422036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.422205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.426128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1047/2075] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:59.427104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.438362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1410383-e2d3-43ae-8e38-098824e87ec4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.445322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.446831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.447169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.447440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.448074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.449649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.454525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] MFA Rules not processed for user `6ffd6f0d01364b5c9d9be5072e38fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:59.456587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.472398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1048/2076] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:59.477095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.491834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a20d2-be70-409e-901d-7eed7071b57a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.497610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.499126 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.499769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.500432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] PATH_INFO: `/v3/projects/60fc857aa21d4909b986dafad7959819/users/c5d6b930b12b421697a891323aa0c98f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.535013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fc857aa21d4909b986dafad7959819, user_id=c5d6b930b12b421697a891323aa0c98f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.537863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1cc4-16f0-48a0-b856-74e5cbe2d80a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.555024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1029/2077] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.556482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1049/2078] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:59 2022] PUT /identity/v3/projects/60fc857aa21d4909b986dafad7959819/users/c5d6b930b12b421697a891323aa0c98f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:21:59.558069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.560204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.580377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.580579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.580793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.585741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e9ee-342e-4570-a43f-5236d2b959b3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.609060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:59.637984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] MFA Rules not processed for user `c5d6b930b12b421697a891323aa0c98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:21:59.639591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:21:59.680794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:21:59.696525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.697152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.697432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.697704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.698419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.700759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.731747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1050/2079] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:21:59.734208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1030/2080] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:21:59.737154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.737982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.750995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc6fe4-e77a-4660-a27a-20c5c198589c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.815144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9504b-cd32-4148-9620-0a253083e684 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.820305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.820881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.821270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.821541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.822092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.824017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.826715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.827442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.827809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.828148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.828930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.831089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.851060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1031/2081] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:59.852615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.863571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1051/2082] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:59.866826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040e13-4b62-4016-b594-7004e53865da admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.867250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.948613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.949040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760977-c83a-4d3d-af05-cc3495b50da1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.949228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.949500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.949786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.950521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.952045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.953891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.954921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.955200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.955469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.956093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:21:59.958020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:21:59.962379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1032/2083] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:21:59.966639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:21:59.982202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb241da-2112-4673-9cff-b38f5cd34c41 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:21:59.985304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1052/2084] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:21:59 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:21:59.990422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:21:59.991125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:21:59.991358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:21:59.992038 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] PATH_INFO: `/v3/projects/a0e459d484634d6ba6afd54be71ac66e/users/6db2643f138f4856bc5989df81e39882/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:21:59.994133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.005374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966afe95-eb06-4bc1-9067-ed3c47b9e252 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.007933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e459d484634d6ba6afd54be71ac66e, user_id=6db2643f138f4856bc5989df81e39882, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.010326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.010687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.011109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.011390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.011666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.012305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.013893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.021003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:00.030288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1053/2085] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:00.031475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.035673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1033/2086] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:21:59 2022] PUT /identity/v3/projects/a0e459d484634d6ba6afd54be71ac66e/users/6db2643f138f4856bc5989df81e39882/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:00.037066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.045790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7d84-d4ae-41e0-96d6-9f11b7563ba8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.092223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:00.113820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.114518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.114790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.115085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] PATH_INFO: `/v3/projects/69265a7409bf4d15878f5f8787d331eb/users/8c5a4ed2ed9e481eb2da97b37ea0d550/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.117663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68afb0-b4b6-4237-88ab-68a8f051286a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.123347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.124327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.124781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.125250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.126089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.127993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.130365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=69265a7409bf4d15878f5f8787d331eb, user_id=8c5a4ed2ed9e481eb2da97b37ea0d550, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.133030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.139990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1034/2087] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:00.144856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.149061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1054/2088] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:00 2022] PUT /identity/v3/projects/69265a7409bf4d15878f5f8787d331eb/users/8c5a4ed2ed9e481eb2da97b37ea0d550/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:00.152898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.158126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd28c-ed12-4cf0-a34b-05fe36a58b7c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.226565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.227938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.227938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.227938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] PATH_INFO: `/v3/projects/a0e459d484634d6ba6afd54be71ac66e/users/6db2643f138f4856bc5989df81e39882/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.230251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e459d484634d6ba6afd54be71ac66e, user_id=6db2643f138f4856bc5989df81e39882, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.232417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831c65c-37ae-4a2c-bf76-c0726903c5de admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.232746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.238032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.238639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.238943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.239239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.239922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.241542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2117-870f-4e62-97a9-66616ca6688e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.249698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1035/2089] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:00 2022] PUT /identity/v3/projects/a0e459d484634d6ba6afd54be71ac66e/users/6db2643f138f4856bc5989df81e39882/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:22:00.252554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1055/2090] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:00.256551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.335247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5569cbb-2eca-4159-a391-c7ec59c0d298 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.340478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.341275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.341592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.341962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] PATH_INFO: `/v3/projects/69265a7409bf4d15878f5f8787d331eb/users/8c5a4ed2ed9e481eb2da97b37ea0d550/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.344139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69265a7409bf4d15878f5f8787d331eb, user_id=8c5a4ed2ed9e481eb2da97b37ea0d550, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.347036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.359339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1036/2091] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:00 2022] PUT /identity/v3/projects/69265a7409bf4d15878f5f8787d331eb/users/8c5a4ed2ed9e481eb2da97b37ea0d550/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:22:00.371070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f471846-0a01-4433-8818-a79825a30812 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.371462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f471846-0a01-4433-8818-a79825a30812 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.371736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f471846-0a01-4433-8818-a79825a30812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.405586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1f471846-0a01-4433-8818-a79825a30812 None None] MFA Rules not processed for user `8c5a4ed2ed9e481eb2da97b37ea0d550`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:00.407092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1f471846-0a01-4433-8818-a79825a30812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:00.520107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1056/2092] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:00.532284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:00.534618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:00.633239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef85a-f315-4521-a44d-5e864353d8e4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:00.637057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:00.637730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:00.638105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:00.638442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:00.660002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:00.699933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:00.701343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:00.711279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1037/2093] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:05.274548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:05.275107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:05.275107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:05.283444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:05.327588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] MFA Rules not processed for user `6db2643f138f4856bc5989df81e39882`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:05.328910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:05.416756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1057/2094] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:05.432191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:05.433618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:05.554566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4729fa-be81-4374-a872-b8eb81430096 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:05.565823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:05.566570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:05.566919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:05.567260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:05.656182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:05.658933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb391-f419-4fa3-b6d9-22d014def78b service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:05.668872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1038/2095] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:05.754270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:05.755619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:05.770442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ef91-3ada-4a8e-b0da-d36384aeba35 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:05.774193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:05.774805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:05.775079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:05.775374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:05.838246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:05.839760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:05.849679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1058/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:06.738304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:06.738829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:06.738829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:06.758496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] MFA Rules not processed for user `6ffd6f0d01364b5c9d9be5072e38fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:06.759688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:06.766773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1039/2097] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:09.283794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:09.292624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e790bf-3d00-4c99-81de-ffa7f2540f99 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:09.296382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:09.297049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:09.297392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:09.297723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:09.307179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:09.308612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:09.318383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1059/2098] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:16.753239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=77 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:18.077920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.079468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:18.142535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b3538-c90a-4578-8e5e-0f7d2de44299 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.147932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.148560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.148833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.149095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] PATH_INFO: `/v3/users/ac719afc003945c7ab9fa308946b23ec` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.150225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac719afc003945c7ab9fa308946b23ec)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.152117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.198097 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac719afc003945c7ab9fa308946b23ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.205059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac719afc003945c7ab9fa308946b23ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.216987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac719afc003945c7ab9fa308946b23ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.217627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac719afc003945c7ab9fa308946b23ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.218303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a48d1294-4ac1-477f-ab37-fa2a94941f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac719afc003945c7ab9fa308946b23ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.230249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1040/2099] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:18 2022] DELETE /identity/v3/users/ac719afc003945c7ab9fa308946b23ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:18.412267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.442370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4611-16a9-4531-bbf5-1e7fab8afd82 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.508672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.509323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.509593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.509866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] PATH_INFO: `/v3/projects/0671e091118a45e8a5dbe85f9a7dcf76` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.511035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0671e091118a45e8a5dbe85f9a7dcf76)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.513073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.529460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:18.562810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0671e091118a45e8a5dbe85f9a7dcf76', 'request_id': 'req-d3dfe2a0-143b-49ed-875e-844c31529acd'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.570611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0671e091118a45e8a5dbe85f9a7dcf76', 'request_id': 'req-d3dfe2a0-143b-49ed-875e-844c31529acd'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.577823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0671e091118a45e8a5dbe85f9a7dcf76', 'request_id': 'req-d3dfe2a0-143b-49ed-875e-844c31529acd'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.589395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] The token cache is being invalidate because project 0671e091118a45e8a5dbe85f9a7dcf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:18.589670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.590395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d3dfe2a0-143b-49ed-875e-844c31529acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:18.591929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1060/2100] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:18 2022] DELETE /identity/v3/projects/0671e091118a45e8a5dbe85f9a7dcf76 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:18.598702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.598987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.599259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.620539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:18.621878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:18.683262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1041/2101] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:18.691010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.691289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.691560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.712744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:18.712945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:18.721805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1061/2102] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:18.726137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.735953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4aa6-1e9e-4f68-89af-9260653d228d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.745048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.745663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.745979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.746254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.746905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:22:18.747206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.748801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.760976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1042/2103] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:22:18.765450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.775204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632780-8cfa-4469-8591-fad8c18e75bc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.780070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.780672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.780947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.781229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.781817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.784229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.817932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1062/2104] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:22:18 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:18.820509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.830647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ecfa-7909-4952-a1d8-bdb1b71c8127 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.834430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:18.892638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.893282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.893809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.894668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.894792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.896600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.918323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1043/2105] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:22:18 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:18.922456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.933766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b093b0e-cda1-4439-9787-a11ee6ce57d5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.938854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.939507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.939838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.940107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.940756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.942579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.953339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1063/2106] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:18.957987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:18.968306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5947d8-979c-4bee-84f3-c898b4ee341a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:18.973510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:18.974129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:18.974403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:18.974670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:18.975299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:18.976902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6855f1-f229-492e-9d41-15e12b934c88 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:18.989024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1044/2107] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:18.992347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:19.002288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca675-2b7d-4ee0-bd12-90086ce27c15 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:19.007130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:19.007776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:19.008050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:19.008350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] PATH_INFO: `/v3/projects/89cd2880bd764ebdb6ae9acdbead040d/users/5ce6653be14c4cd1b25ef3fe20739c12/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:19.024589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cd2880bd764ebdb6ae9acdbead040d, user_id=5ce6653be14c4cd1b25ef3fe20739c12, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:19.027285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:19.042466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1064/2108] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:18 2022] PUT /identity/v3/projects/89cd2880bd764ebdb6ae9acdbead040d/users/5ce6653be14c4cd1b25ef3fe20739c12/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:22:19.047393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247964-4dfc-40f5-9483-39a05655940d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:19.047676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247964-4dfc-40f5-9483-39a05655940d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:19.047943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f247964-4dfc-40f5-9483-39a05655940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:19.066444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2f247964-4dfc-40f5-9483-39a05655940d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:19.067731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f247964-4dfc-40f5-9483-39a05655940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:19.130054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1045/2109] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:22:19.139430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:19.141107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:19.201151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d118e-811b-4884-ba64-61d52ea194ca admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:19.205066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:19.206171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:19.206448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:19.206713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:19.216013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:19.217463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:19.227783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1065/2110] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:23.402293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039261-a5ce-4172-a1de-e90fad1867cc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:23.402727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039261-a5ce-4172-a1de-e90fad1867cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:23.402842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039261-a5ce-4172-a1de-e90fad1867cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:23.435868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e3039261-a5ce-4172-a1de-e90fad1867cc None None] MFA Rules not processed for user `5ce6653be14c4cd1b25ef3fe20739c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:23.436810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e3039261-a5ce-4172-a1de-e90fad1867cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:23.538418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1046/2111] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:23.554315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:23.555772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:23.618469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:23.658356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759306-94ca-4900-9cd3-3e30320cc8ca service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:23.664557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:23.665292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:23.665667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:23.666086 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:23.676409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:23.678074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:23.688025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1066/2112] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:25.106426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e519f-2876-4982-b769-d441ec14927c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:25.106977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e519f-2876-4982-b769-d441ec14927c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:25.107196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e519f-2876-4982-b769-d441ec14927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:25.127704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-002e519f-2876-4982-b769-d441ec14927c None None] MFA Rules not processed for user `5ce6653be14c4cd1b25ef3fe20739c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:25.129032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-002e519f-2876-4982-b769-d441ec14927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:25.138798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1047/2113] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:25.213494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:25.214977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:25.242379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cf553-2005-4cb5-bd9a-977f9decda06 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:25.248288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:25.248796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:25.249077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:25.249356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] PATH_INFO: `/v3/users/123f284450a64aaaa1d79a99ef3ad8ae` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:25.252600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123f284450a64aaaa1d79a99ef3ad8ae)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:25.258658 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:25.360576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123f284450a64aaaa1d79a99ef3ad8ae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:25.374158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123f284450a64aaaa1d79a99ef3ad8ae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:25.406653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123f284450a64aaaa1d79a99ef3ad8ae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:25.421436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123f284450a64aaaa1d79a99ef3ad8ae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:25.422765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123f284450a64aaaa1d79a99ef3ad8ae'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:25.430288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1067/2114] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:25 2022] DELETE /identity/v3/users/123f284450a64aaaa1d79a99ef3ad8ae => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:25.434601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:25.434959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:25.435389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:25.456617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:25.458500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:25.462981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:25.540426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1048/2115] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:25.552544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:25.554235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:25.624962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60631cc-1880-4b7d-8a63-f364ec27a732 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:25.629333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:25.630273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:25.630767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:25.631323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:25.643290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:25.645118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:25.662100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1068/2116] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:26.000237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:26.004708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:26.061569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b10002-f6cf-4118-aac9-3aa45b1432ed None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:26.069873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:26.071757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:26.072188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:26.072619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] PATH_INFO: `/v3/projects/add3369ff549477aadcfc34e6973ac26` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:26.073997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=add3369ff549477aadcfc34e6973ac26)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:26.076901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:26.160473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add3369ff549477aadcfc34e6973ac26', 'request_id': 'req-e7588037-0060-404d-8f03-7ce53de1fafe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.172181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add3369ff549477aadcfc34e6973ac26', 'request_id': 'req-e7588037-0060-404d-8f03-7ce53de1fafe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.188554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add3369ff549477aadcfc34e6973ac26', 'request_id': 'req-e7588037-0060-404d-8f03-7ce53de1fafe'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.211119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] The token cache is being invalidate because project add3369ff549477aadcfc34e6973ac26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:26.211562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.212506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.218921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:26.219361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1049/2117] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:25 2022] DELETE /identity/v3/projects/add3369ff549477aadcfc34e6973ac26 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:26.230904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee047e3-e5f7-45d2-b51a-48edb2fe01c2 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:26.308945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:26.332747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:26.333680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:26.333854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:26.334256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] PATH_INFO: `/v3/users/c5d6b930b12b421697a891323aa0c98f` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:26.335674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d6b930b12b421697a891323aa0c98f)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:26.337981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:26.398792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d6b930b12b421697a891323aa0c98f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.407555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d6b930b12b421697a891323aa0c98f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.424455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d6b930b12b421697a891323aa0c98f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.435528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d6b930b12b421697a891323aa0c98f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.436541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d6b930b12b421697a891323aa0c98f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:26.443533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1069/2118] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:26 2022] DELETE /identity/v3/users/c5d6b930b12b421697a891323aa0c98f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:22:26.964205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:26.965806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:26.984374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7588037-0060-404d-8f03-7ce53de1fafe admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:27.050622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:27.051281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:27.051786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:27.051786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] PATH_INFO: `/v3/projects/60fc857aa21d4909b986dafad7959819` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:27.052972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fc857aa21d4909b986dafad7959819)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:27.054922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:27.107133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:27.127740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fc857aa21d4909b986dafad7959819', 'request_id': 'req-85b08ac8-9fed-41d8-bdea-12c1e3859095'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.138602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fc857aa21d4909b986dafad7959819', 'request_id': 'req-85b08ac8-9fed-41d8-bdea-12c1e3859095'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.152467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fc857aa21d4909b986dafad7959819', 'request_id': 'req-85b08ac8-9fed-41d8-bdea-12c1e3859095'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.167334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] The token cache is being invalidate because project 60fc857aa21d4909b986dafad7959819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:27.167903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.168730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.175915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1050/2119] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:26 2022] DELETE /identity/v3/projects/60fc857aa21d4909b986dafad7959819 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:27.177935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:27.179615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:27.201806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c34b-3dd6-42bf-873a-3ef56f805e31 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:27.292523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:27.293166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:27.293479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:27.293700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] PATH_INFO: `/v3/users/8c5a4ed2ed9e481eb2da97b37ea0d550` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:27.294929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5a4ed2ed9e481eb2da97b37ea0d550)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:27.296864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:27.365773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5a4ed2ed9e481eb2da97b37ea0d550'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.375936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5a4ed2ed9e481eb2da97b37ea0d550'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.390065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:27.398863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5a4ed2ed9e481eb2da97b37ea0d550'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.412074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5a4ed2ed9e481eb2da97b37ea0d550'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.412950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5a4ed2ed9e481eb2da97b37ea0d550'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:27.429364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1070/2120] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:27 2022] DELETE /identity/v3/users/8c5a4ed2ed9e481eb2da97b37ea0d550 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:27.828168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:27.830646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:27.846126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08ac8-9fed-41d8-bdea-12c1e3859095 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:27.937814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:27.938534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:27.938815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:27.939087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] PATH_INFO: `/v3/projects/69265a7409bf4d15878f5f8787d331eb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:27.940841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69265a7409bf4d15878f5f8787d331eb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:27.943353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:28.001353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69265a7409bf4d15878f5f8787d331eb', 'request_id': 'req-2f080b0d-e04d-4286-ab0f-a798203da39f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:28.008541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69265a7409bf4d15878f5f8787d331eb', 'request_id': 'req-2f080b0d-e04d-4286-ab0f-a798203da39f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:28.019091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69265a7409bf4d15878f5f8787d331eb', 'request_id': 'req-2f080b0d-e04d-4286-ab0f-a798203da39f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:28.030254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] The token cache is being invalidate because project 69265a7409bf4d15878f5f8787d331eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:28.030545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:28.031192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2f080b0d-e04d-4286-ab0f-a798203da39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:28.032714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1051/2121] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:27 2022] DELETE /identity/v3/projects/69265a7409bf4d15878f5f8787d331eb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:37.415692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=7,keystone:DELETE=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:38.027076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:46.266177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:46.268110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:46.280782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc0043-2163-42a1-8caa-52547cd5f8e9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:46.342189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:46.342822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:46.343100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:46.343367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] PATH_INFO: `/v3/users/f8d50a4d18174641a4f737ecb3d68893` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:46.344479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d50a4d18174641a4f737ecb3d68893)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:46.346830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:46.395680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d50a4d18174641a4f737ecb3d68893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:46.403187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d50a4d18174641a4f737ecb3d68893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:46.415663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d50a4d18174641a4f737ecb3d68893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:46.422376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d50a4d18174641a4f737ecb3d68893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:46.423029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d50a4d18174641a4f737ecb3d68893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:46.428866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1071/2122] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:46 2022] DELETE /identity/v3/users/f8d50a4d18174641a4f737ecb3d68893 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:46.433553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:46.434072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:46.434175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:46.453356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:46.455184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:46.511768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1052/2123] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:46.522469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:46.523893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:46.580569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a2fff-57f2-4fdb-9aa5-9b3cadb4ec09 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:46.584322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:46.584970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:46.585227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:46.585496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:46.594416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:46.595855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b185a7-d0b1-4188-9337-b1382a8f882a service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:46.604990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1072/2124] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:47.073603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.075012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:47.097852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26753b83-a316-4829-a172-0425b5bbf437 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.104485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.105275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.106179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.106179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] PATH_INFO: `/v3/projects/53cdd3531d144288ad7687e123bd97bf` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.107227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cdd3531d144288ad7687e123bd97bf)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.109324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.187292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cdd3531d144288ad7687e123bd97bf', 'request_id': 'req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:47.194422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cdd3531d144288ad7687e123bd97bf', 'request_id': 'req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:47.202536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cdd3531d144288ad7687e123bd97bf', 'request_id': 'req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:47.217931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] The token cache is being invalidate because project 53cdd3531d144288ad7687e123bd97bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:47.218668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:47.219342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a9639032-6a2e-4270-b6c3-629dc0cdcbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:47.222192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1053/2125] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:47 2022] DELETE /identity/v3/projects/53cdd3531d144288ad7687e123bd97bf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:47.227187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.227571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.227918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.271380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:47.271380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:47.300288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:47.348565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1073/2126] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:47.356331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.356612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.356883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.377378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:47.378617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:47.386686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1054/2127] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:47.391355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.401976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b9db3-2a82-4e85-9aae-e343034b434a None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.406440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.407033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.407312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.407630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.408269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:22:47.408690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.410321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.422561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1074/2128] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:22:47.427501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.436772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa93be-64ff-4333-a211-80a298de3273 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.441789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.442791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.442791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.443012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.443705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.445647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.475124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1055/2129] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:22:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:47.479904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.492705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65c55-a6c4-43d2-94ac-408beb56af5d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.583996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.584619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.584898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.585169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.586014 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.587976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.619244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1075/2130] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:22:47 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:47.623021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.637250 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9717-b1b9-4f34-b206-7fa20eebb8ca admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.644154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.644922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.645199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.645471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.646151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.648253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.662821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1056/2131] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:47.666827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.678953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e0741-94d2-4d35-8ee6-4f6e09962b4a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.685251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.685875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.686185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.686548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.687275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.690482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a515790-5a0c-498b-959d-3db0221090c0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.716830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1076/2132] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:22:47.721603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.741960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7336f-d422-43ce-94ce-be08b2068db4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:47.747678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:47.748350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.748702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.748976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] PATH_INFO: `/v3/projects/87a19aa527184f848e81861faa50b46f/users/bc80f1ff6c9d4f64ba4c79f03420e559/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.769684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a19aa527184f848e81861faa50b46f, user_id=bc80f1ff6c9d4f64ba4c79f03420e559, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:47.775452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:47.794986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1057/2133] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:47 2022] PUT /identity/v3/projects/87a19aa527184f848e81861faa50b46f/users/bc80f1ff6c9d4f64ba4c79f03420e559/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:47.806585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:47.806969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:47.807310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:47.846618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] MFA Rules not processed for user `bc80f1ff6c9d4f64ba4c79f03420e559`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:47.847762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:47.928223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1077/2134] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:22:47.939937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:47.941734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:47.965067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:48.005949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea962a-1182-49b9-8013-bec024a4e6a6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:48.009689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:48.010335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:48.010613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:48.010890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:48.020988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:48.022487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a7c7b-36f3-47bf-a31c-af1795733724 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:48.032418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1058/2135] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:50.674963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:50.699984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:50.747041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21213-27d4-4a2c-908d-d196abcd5da6 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:50.755524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:50.756487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:50.756863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:50.757397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] PATH_INFO: `/v3/users/bc80f1ff6c9d4f64ba4c79f03420e559` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:50.759204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc80f1ff6c9d4f64ba4c79f03420e559)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:50.761570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:50.847679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc80f1ff6c9d4f64ba4c79f03420e559'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:50.856236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc80f1ff6c9d4f64ba4c79f03420e559'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:50.868688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc80f1ff6c9d4f64ba4c79f03420e559'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:50.877049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc80f1ff6c9d4f64ba4c79f03420e559'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:50.878298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc80f1ff6c9d4f64ba4c79f03420e559'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:50.888669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1078/2136] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:50 2022] DELETE /identity/v3/users/bc80f1ff6c9d4f64ba4c79f03420e559 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:50.890301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:50.890796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:50.891361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:50.911635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:50.913151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:50.977666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1059/2137] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:50.987308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:50.988682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:51.046167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d59aaf-68e5-46b2-beba-bdfe1bf549b7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:51.049795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:51.050497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:51.050770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:51.051036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:51.059838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:51.061242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:51.071327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1079/2138] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:51.338715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:51.340288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:51.353624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ea07-e33a-4def-a22f-069d4da10b59 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:51.358966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:51.359603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:51.359923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:51.360149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] PATH_INFO: `/v3/projects/87a19aa527184f848e81861faa50b46f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:51.363521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a19aa527184f848e81861faa50b46f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:51.365478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:51.441116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a19aa527184f848e81861faa50b46f', 'request_id': 'req-e19e7d18-2dc5-46c1-a899-0350911ddbff'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.449107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a19aa527184f848e81861faa50b46f', 'request_id': 'req-e19e7d18-2dc5-46c1-a899-0350911ddbff'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.459362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a19aa527184f848e81861faa50b46f', 'request_id': 'req-e19e7d18-2dc5-46c1-a899-0350911ddbff'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.472533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] The token cache is being invalidate because project 87a19aa527184f848e81861faa50b46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:51.472827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.473612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e19e7d18-2dc5-46c1-a899-0350911ddbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.475510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1060/2139] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:51 2022] DELETE /identity/v3/projects/87a19aa527184f848e81861faa50b46f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:51.716498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:51.717891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:51.730988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a36db-f357-4201-b9ea-719ac10e1d01 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:51.769052 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:51.789165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:51.789787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:51.790097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:51.790366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] PATH_INFO: `/v3/users/c1e550f891254d91b3e0375cff938e1d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:51.791471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e550f891254d91b3e0375cff938e1d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:51.793399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:51.836924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e550f891254d91b3e0375cff938e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.843962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e550f891254d91b3e0375cff938e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.857256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e550f891254d91b3e0375cff938e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.864783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e550f891254d91b3e0375cff938e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.865464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e550f891254d91b3e0375cff938e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:51.871218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1080/2140] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:22:51 2022] DELETE /identity/v3/users/c1e550f891254d91b3e0375cff938e1d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:51.875994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:51.876314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:51.876582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:51.896826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:51.898052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:51.943360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:51.963780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1061/2141] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:22:51.974136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:51.975843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:52.067833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b35e-60a8-464c-b4df-a883a4134a03 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:52.073441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:52.074230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:52.074615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:52.075056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:52.087033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:52.088609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f2ca2-6361-4670-b621-33b76e55baa3 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:52.101525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1081/2142] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:22:52.982055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:52.984046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:52.997213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d69b-4aa1-4c47-b84c-ec9f60a96b31 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.002729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.003647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.004075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.004497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] PATH_INFO: `/v3/projects/3850f1ce2ae04895b9e91b33c2f9eb46` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.005772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3850f1ce2ae04895b9e91b33c2f9eb46)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.007858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.091378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3850f1ce2ae04895b9e91b33c2f9eb46', 'request_id': 'req-ad2777b0-4070-4166-ae45-7d2a22c15419'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:53.101315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3850f1ce2ae04895b9e91b33c2f9eb46', 'request_id': 'req-ad2777b0-4070-4166-ae45-7d2a22c15419'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:53.111710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3850f1ce2ae04895b9e91b33c2f9eb46', 'request_id': 'req-ad2777b0-4070-4166-ae45-7d2a22c15419'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:53.124636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] The token cache is being invalidate because project 3850f1ce2ae04895b9e91b33c2f9eb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:22:53.125245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:53.126321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad2777b0-4070-4166-ae45-7d2a22c15419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:22:53.129638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1062/2143] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:22:52 2022] DELETE /identity/v3/projects/3850f1ce2ae04895b9e91b33c2f9eb46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:53.134865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.135792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.136372 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.166031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:53.168476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:53.250664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1082/2144] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:53.259391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.260350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.260896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.290158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:53.291933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:53.318510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1063/2145] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:22:53.322442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.328749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:22:53.340919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c04e2-8931-4c26-8a12-5084b2caabf8 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.354147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.355153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.355726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.356125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.356976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:22:53.357441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.359799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.380012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1083/2146] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:22:53.381298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.392036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6b8fb-7189-4077-a61d-8f950ec735be None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.398657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.399476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.399783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.400159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.401301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.403841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.443352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1064/2147] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:22:53 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:22:53.444115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.457186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119702-61bf-4958-bde8-c53213ed5b96 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.523870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.524635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.525604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.525984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.526774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.530328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.598014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.610055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1084/2148] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:22:53 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:22:53.616543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3d76-b2f3-47e2-aeac-be95acb70087 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.622736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.623477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.623872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.624216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.624934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.626751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.647704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1065/2149] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:22:53.648529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.661978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3fff-1118-41a5-b0e4-6e9f173fe23b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.667451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.668064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.668341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.668610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.669289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.670938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468ed3-6619-4a6d-8be3-6ac346ad41a0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.683188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1085/2150] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:22:53.687191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.697681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3c701-94d2-4acf-8bbe-6578cbb4045e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:53.702470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:53.703130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.703412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.704769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] PATH_INFO: `/v3/projects/00f486b650cd45869f8cbdcd4321bac0/users/896a6ab9350346f891bc40bd055d04c9/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.721670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f486b650cd45869f8cbdcd4321bac0, user_id=896a6ab9350346f891bc40bd055d04c9, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:53.724916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:53.745347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1066/2151] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:22:53 2022] PUT /identity/v3/projects/00f486b650cd45869f8cbdcd4321bac0/users/896a6ab9350346f891bc40bd055d04c9/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:22:53.757992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71492e4e-67b1-4f2a-941c-1a35e5d71de2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:53.759657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71492e4e-67b1-4f2a-941c-1a35e5d71de2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:53.759657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71492e4e-67b1-4f2a-941c-1a35e5d71de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:53.817300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-71492e4e-67b1-4f2a-941c-1a35e5d71de2 None None] MFA Rules not processed for user `896a6ab9350346f891bc40bd055d04c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:22:53.818636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-71492e4e-67b1-4f2a-941c-1a35e5d71de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:53.919406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1086/2152] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:22:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:22:53.931418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:22:53.933749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:22:53.999180 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598241-fcb8-4cac-aad7-b04bb293ec46 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:22:54.004798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:22:54.005422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:22:54.006013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:22:54.006434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:22:54.018086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:22:54.019763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:22:54.032610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1067/2153] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:22:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:03.915571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:04.025585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:11.676672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:11.677178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:11.677327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:11.698579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] MFA Rules not processed for user `c2d6b067b6c24b53957ef39d3d00242b`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:11.699947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:11.758797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1087/2154] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:12.170089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:12.171489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:12.234486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b9c3-0366-4e61-ab4e-0614f5657440 service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:12.238876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:12.239583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:12.239855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:12.240219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:12.242121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:12.323984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:12.326416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:12.342159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1068/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:12.914729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:12.916185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:12.989830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6477f-56e3-46a9-b94d-4f233aeffcb0 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:12.995012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:12.995634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:12.995908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:12.996177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:12.997964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:13.010028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:13.011634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd71eb-b898-4cf9-bdba-2eba5d473c03 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:13.023061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1088/2156] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:22.334899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=50 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:23.018575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=57 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:31.546201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:31.610600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce0a5-4ba3-492d-8c69-72e5ed9ebaf0 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:31.615390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:31.616029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:31.616300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:31.616567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] PATH_INFO: `/v3/users/896a6ab9350346f891bc40bd055d04c9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:31.617690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=896a6ab9350346f891bc40bd055d04c9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:31.619688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:31.670178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896a6ab9350346f891bc40bd055d04c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:31.679067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896a6ab9350346f891bc40bd055d04c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:31.693243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896a6ab9350346f891bc40bd055d04c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:31.693987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896a6ab9350346f891bc40bd055d04c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:31.694555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896a6ab9350346f891bc40bd055d04c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:31.706612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1069/2157] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:23:31 2022] DELETE /identity/v3/users/896a6ab9350346f891bc40bd055d04c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:31.711037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:31.711506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:31.711599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:31.729685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:31.730822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:31.793638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1089/2158] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:31.803929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:31.805383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:31.862368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21ff9-0e10-4d00-b7e8-b88eba947c6e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:31.865948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:31.866537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:31.866809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:31.867072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:31.876464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:31.877870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3bab8-ec34-4512-a127-c33e94b2257a service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:31.887590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1070/2159] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:32.154497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.156003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:32.168483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c558b5-82df-454f-b37d-c1d2588b78e2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.173721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.174388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.174660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.174924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] PATH_INFO: `/v3/projects/00f486b650cd45869f8cbdcd4321bac0` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.176032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f486b650cd45869f8cbdcd4321bac0)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.178001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.228098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f486b650cd45869f8cbdcd4321bac0', 'request_id': 'req-8683effb-2a9f-429e-a566-c13a3839a18a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:32.236667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f486b650cd45869f8cbdcd4321bac0', 'request_id': 'req-8683effb-2a9f-429e-a566-c13a3839a18a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:32.243218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f486b650cd45869f8cbdcd4321bac0', 'request_id': 'req-8683effb-2a9f-429e-a566-c13a3839a18a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:32.254233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] The token cache is being invalidate because project 00f486b650cd45869f8cbdcd4321bac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:23:32.254514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:32.255187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-8683effb-2a9f-429e-a566-c13a3839a18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:32.256656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1090/2160] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:23:32 2022] DELETE /identity/v3/projects/00f486b650cd45869f8cbdcd4321bac0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:32.262100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.262381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.262646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.281565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:32.283267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:32.299949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:32.342386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1071/2161] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:32.350531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.350813 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.351084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.371212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:32.372403 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:32.380179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1091/2162] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:32.384391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.394674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf21ff-8d12-4af7-89f1-3ca84538b4c6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.399325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.399918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.400195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.400464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.401098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:23:32.401398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.403008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.414909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1072/2163] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:23:32.419205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.428212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630d51-1e07-4e48-9bb6-e32a7fdf4037 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.432858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.433439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.433714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.434020 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.434631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.436518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.463580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1092/2164] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:23:32 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:32.467620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.477866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064354-1707-4a4d-9aa0-998f7d8ea1aa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.533604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.534242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.534516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.534780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.535401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.537323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.559827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1073/2165] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:23:32 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:32.565235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.575447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd853a-577e-4528-8bb1-fbf55fcbd1c8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.580467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.581049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.581324 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.581594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.582253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.583834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.595684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1093/2166] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:23:32.599668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.609620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec07e-b716-4b54-80a8-c59d6e6ee305 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.614203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.614769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.615118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.615396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.616024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.617616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a3926-3f28-4845-9e89-36465cae543e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.627928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1074/2167] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:23:32.631962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.645285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4f23-a8d5-4d53-9b95-f233e64c7b93 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.649931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.650565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.650839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.651128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] PATH_INFO: `/v3/projects/637e1db91f2b4afe89fff9ffea2ce619/users/0d67b4b309d944a4924149258f6fb9c1/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.666575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637e1db91f2b4afe89fff9ffea2ce619, user_id=0d67b4b309d944a4924149258f6fb9c1, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.669219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.682134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1094/2168] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:23:32 2022] PUT /identity/v3/projects/637e1db91f2b4afe89fff9ffea2ce619/users/0d67b4b309d944a4924149258f6fb9c1/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:32.693335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.693627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.693920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.721782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] MFA Rules not processed for user `0d67b4b309d944a4924149258f6fb9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:32.723004 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:32.786462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1075/2169] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:32.796980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:32.798804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:32.820596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:32.857392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959676d8-5859-4991-a878-c66af1a704e7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:32.861284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:32.861887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:32.862198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:32.862471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:32.872980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:32.875056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8fd1-ff29-42ba-a43b-b038bd4d8fb8 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:32.885206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1095/2170] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:42.770656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:42.789541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:42.833283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c395-f65d-43ed-9202-f931ca339082 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:42.837728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:42.838370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:42.838648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:42.838919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] PATH_INFO: `/v3/users/0d67b4b309d944a4924149258f6fb9c1` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:42.840019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d67b4b309d944a4924149258f6fb9c1)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:42.841930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:42.880711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=17 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:42.887858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d67b4b309d944a4924149258f6fb9c1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:42.895805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d67b4b309d944a4924149258f6fb9c1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:42.907561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d67b4b309d944a4924149258f6fb9c1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:42.908184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d67b4b309d944a4924149258f6fb9c1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:42.908780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d67b4b309d944a4924149258f6fb9c1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:42.920653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1076/2171] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:23:42 2022] DELETE /identity/v3/users/0d67b4b309d944a4924149258f6fb9c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:42.925601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:42.925881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:42.926182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:42.944773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:42.945975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.004531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1096/2172] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:23:43.014093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.015503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.071020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45396b-db83-4ab7-9897-da98f4613bc7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.074670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.075260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.075532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.075795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.085191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.086605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94137eb-14de-4be7-afae-de34219bb832 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.099023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1077/2173] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:43.362169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.363655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.375662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e382a-e67b-4cb0-aea3-4b595003ea91 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.380386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.381047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.381321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.381591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] PATH_INFO: `/v3/projects/637e1db91f2b4afe89fff9ffea2ce619` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.382792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637e1db91f2b4afe89fff9ffea2ce619)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.384700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.431784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637e1db91f2b4afe89fff9ffea2ce619', 'request_id': 'req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:43.439105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637e1db91f2b4afe89fff9ffea2ce619', 'request_id': 'req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:43.445513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637e1db91f2b4afe89fff9ffea2ce619', 'request_id': 'req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:43.455747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] The token cache is being invalidate because project 637e1db91f2b4afe89fff9ffea2ce619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:23:43.456029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:43.456654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0f5ecaa8-86f4-4e74-9117-6c5b081e78a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:23:43.458171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1097/2174] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:23:43 2022] DELETE /identity/v3/projects/637e1db91f2b4afe89fff9ffea2ce619 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:23:43.463436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.463779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.464130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.483847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:43.485656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.516989 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:43.543478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1078/2175] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:43.551675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.551955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.552224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.572852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:43.574407 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.582362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1098/2176] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:43.586490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.596474 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee30b-cfe3-433f-93e0-e9572485b337 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.601006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.601595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.601873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.602174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.602814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:23:43.603117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.604743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.616581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1079/2177] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:23:43.620712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.630107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0846-0e57-4eb9-a1ff-16fa3637af50 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.634640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.635238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.635512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.635780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.636523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.638802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.665706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1099/2178] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:23:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:43.669753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.679488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab075-d2df-44b1-946b-ebb61814b887 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.735202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.735791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.736065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.736328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.736933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.738864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.760052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1080/2179] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:23:43 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:23:43.764070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.774874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ddec8-efa4-4d33-909a-13d957f24c5c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.779351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.779931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.780200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.780464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.781091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.783332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.793353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1100/2180] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:23:43.796992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.806681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bff5-9a37-4958-87fb-96b65a4598fc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.811264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.811851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.812126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.812391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.813015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.814613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9071-1abe-4c93-b462-94230b4b50ce admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.824829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1081/2181] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:23:43.829121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.838572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f683-f1f5-4cfa-bed0-e32f693e9323 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:43.843084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:43.844318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.844592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.844855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] PATH_INFO: `/v3/projects/57bc52b03f3544bcbc82320136ff3c0d/users/c237e219ae4947d296a60173faa21753/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.858856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bc52b03f3544bcbc82320136ff3c0d, user_id=c237e219ae4947d296a60173faa21753, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:43.861426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:43.874155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1101/2182] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:23:43 2022] PUT /identity/v3/projects/57bc52b03f3544bcbc82320136ff3c0d/users/c237e219ae4947d296a60173faa21753/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:23:43.879057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684a56-d084-46df-a33f-5cdfeac3a038 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:43.879340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684a56-d084-46df-a33f-5cdfeac3a038 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:43.879606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684a56-d084-46df-a33f-5cdfeac3a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:43.898602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-03684a56-d084-46df-a33f-5cdfeac3a038 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:43.899775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-03684a56-d084-46df-a33f-5cdfeac3a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.955717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1082/2183] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:43.965451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:43.967161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:43.988935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:44.032723 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7e8ca-b145-42a8-a073-ce8d1f78ab03 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:44.037071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:44.037958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:44.038373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:44.038766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:44.049729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:44.052011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:44.064436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1102/2184] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:44.664394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26525-bc86-4436-ad26-11019b946f96 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:44.664764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26525-bc86-4436-ad26-11019b946f96 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:44.665033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26525-bc86-4436-ad26-11019b946f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:44.695377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c1e26525-bc86-4436-ad26-11019b946f96 None None] MFA Rules not processed for user `c237e219ae4947d296a60173faa21753`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:44.696612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c1e26525-bc86-4436-ad26-11019b946f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:44.731626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:44.767081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1083/2185] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:44.778341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:23:44.779745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:44.838933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045bf-dfa5-4e65-85c5-7c38ed199eb4 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:23:44.842568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:23:44.844270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:44.844706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:44.845005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:44.853312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:23:44.854783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35096-9783-474f-b85f-ffbd413447bc service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:23:44.864065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1103/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:23:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:23:46.218991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c982-d6f3-4669-a93a-265eb20b8735 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:23:46.219579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c982-d6f3-4669-a93a-265eb20b8735 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:23:46.219579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c982-d6f3-4669-a93a-265eb20b8735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:23:46.238522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fd38c982-d6f3-4669-a93a-265eb20b8735 None None] MFA Rules not processed for user `c237e219ae4947d296a60173faa21753`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:23:46.239690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fd38c982-d6f3-4669-a93a-265eb20b8735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:23:46.246319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1084/2187] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:23:54.859492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=43 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:23:56.233832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=14 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:08.648906 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:08.649442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:08.649442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:08.668009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] MFA Rules not processed for user `7bd39d1cce924d77979ded850bbfbea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:08.669198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:08.723689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1104/2188] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:24:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:18.715465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=25 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:24:44.443411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:44.443896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:44.443992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:44.462946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:24:44.464122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:44.519959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1085/2189] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:24:44.562451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:44.563849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:44.631538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510a2c-97a2-4339-8586-adaffc382a41 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:44.636345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:44.636941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:44.637213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:44.637478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:44.646085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:44.647649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:44.655465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1105/2190] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:24:49.858335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:49.860447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:49.872233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513ea4-463d-4577-a408-226e3b76ba45 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:49.875849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:49.876456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:49.878019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:49.878019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:49.881932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:49.988617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:49.990791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb9885-2b70-4d42-b327-b2c7162864fb service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:50.008389 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1086/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:24:51.211370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:24:51.224845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af3094-c317-4c79-9957-4aa89d0ba5f1 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:24:51.234939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:24:51.235802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:24:51.236223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:24:51.236400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:24:51.238724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:24:51.259529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:24:51.261249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b2bda-9e09-457b-922d-6640f3e04c10 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:24:51.282572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1106/2192] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:24:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:00.003458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=59 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:01.277483 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=38 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:01.554270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.554853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.554853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.556447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1087/2193] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:25:01.565017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1924d-6d22-4439-bee9-89db5956320c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.565346 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1924d-6d22-4439-bee9-89db5956320c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.566009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1924d-6d22-4439-bee9-89db5956320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.588109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bfb1924d-6d22-4439-bee9-89db5956320c None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:01.589448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bfb1924d-6d22-4439-bee9-89db5956320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:01.601276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1107/2194] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:01.619244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:01.620957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:01.682570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901d3a-0d28-4dfb-bb7a-a0aeb643c967 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:01.686114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:01.686718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.686992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.687257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.697842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:01.699276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b66315-e526-4d02-91b6-8d5b06de57bc service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:01.710385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1088/2195] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:01.778394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a976-5688-481b-bd56-76bc30ec95ea None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.778620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a976-5688-481b-bd56-76bc30ec95ea None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.778844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a976-5688-481b-bd56-76bc30ec95ea None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.780193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1108/2196] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:25:01.786122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4878-e6e0-4f60-b4cf-5ab624ee21dc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.786473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4878-e6e0-4f60-b4cf-5ab624ee21dc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.786781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4878-e6e0-4f60-b4cf-5ab624ee21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.807813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-249b4878-e6e0-4f60-b4cf-5ab624ee21dc None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:01.808985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-249b4878-e6e0-4f60-b4cf-5ab624ee21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:01.815611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1089/2197] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:25:01.827186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6a976-5688-481b-bd56-76bc30ec95ea None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:01.838697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6a976-5688-481b-bd56-76bc30ec95ea None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:01.842167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:01.842755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.843028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.843296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.850215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:01.851633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b897d1c-3526-4aa2-8aa0-1f24e194b612 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:01.859259 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1109/2198] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:01.941827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1c79-357c-4ebc-a70e-226b0688974e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.942179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1c79-357c-4ebc-a70e-226b0688974e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.942455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1c79-357c-4ebc-a70e-226b0688974e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.943802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1090/2199] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:25:01.949523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:01.949805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:01.950104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:01.968894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:01.970591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:01.979750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1110/2200] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:01.991602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e1c79-357c-4ebc-a70e-226b0688974e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:02.002959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e1c79-357c-4ebc-a70e-226b0688974e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:02.006660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:02.007256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:02.007532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:02.007795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:02.018726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:02.020130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf7732-16ff-4588-8b70-b96fce9eb898 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:02.031013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1091/2201] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:04.115521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:04.125197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188578b-bf86-46b2-b74d-9b43fac8d246 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:04.129884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:04.130513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:04.130783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:04.131044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:04.132915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:04.194919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:04.196361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:04.206676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1111/2202] 10.222.0.30 () {60 vars in 1396 bytes} [Sun Aug 7 18:25:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:06.732779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23b56-ad8b-4a3e-8946-9dbc0b134fd8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:06.733213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23b56-ad8b-4a3e-8946-9dbc0b134fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:06.733311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23b56-ad8b-4a3e-8946-9dbc0b134fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:06.754928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8bb23b56-ad8b-4a3e-8946-9dbc0b134fd8 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:06.756549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8bb23b56-ad8b-4a3e-8946-9dbc0b134fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:06.763509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1092/2203] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:06.776734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:06.788393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8067ad7-f136-40eb-8280-ea045e72d5f2 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:06.793625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:06.794337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:06.794610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:06.794881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:06.803891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:06.805465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:06.814314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1112/2204] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:25:16.747394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=38 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:16.810760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=46 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:22.331964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:22.332577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:22.332577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:22.355266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] MFA Rules not processed for user `c237e219ae4947d296a60173faa21753`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:22.356528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:22.365987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1093/2205] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:22.677812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:22.687072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe4999-3eeb-4a40-9789-ecb274e8b846 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:22.690776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:22.691371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:22.691644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:22.691913 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:22.693645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:22.703361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:22.704794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:22.713564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1113/2206] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:23.016710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:23.019177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:23.088895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b095ca7-a553-4046-b2f8-492f6d254a71 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:23.093982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:23.094583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:23.094855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:23.095119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:23.096824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:23.107849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:23.109390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f77d3-746a-4192-b3c8-29ba8fe1235b service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:23.118869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1094/2207] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:24.328559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:24.337434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9e15-5aec-4833-ab4a-4a8ea9fe0381 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:24.341134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:24.341724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:24.342208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:24.342477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:24.344282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:24.354490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:24.355903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:24.364068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1114/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:25:33.115035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=35 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:34.360205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=12 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:40.359564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:40.360052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:40.360171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:40.379447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:25:40.380756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:40.387836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1095/2209] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:25:40.400420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:40.412823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa265f0-035a-47f8-aa8a-14e64349d874 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:40.417955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:40.418714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:40.418992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:40.419311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:40.427831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:40.429522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:40.437501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1115/2210] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:25:50.374780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:50.434362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=6 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:25:57.752281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:25:57.753977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:57.770238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e165f0-3dc2-4cc4-8029-bbfafffcdf48 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:25:57.775617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:25:57.776209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:25:57.776484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:25:57.776752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:25:57.778469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:25:57.836932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:25:57.838537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd85bda-80a6-4e9e-bc07-e38bc73b38e8 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:25:57.847393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1096/2211] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:07.843292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=28 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:13.236365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:13.248535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5a0a-f6f9-42d7-a2df-1e5c3213db0a service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:13.254549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:13.255147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:13.255419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:13.255689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:13.257391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:13.270835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:13.272406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:13.283130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1116/2212] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:23.278442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=6 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:35.382607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:35.383122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:35.383226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:35.401658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] MFA Rules not processed for user `c2d6b067b6c24b53957ef39d3d00242b`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:35.402866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:35.409805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1097/2213] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:40.497183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.508344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d77923-dbe3-42d3-8d12-c2985f6ae1db service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.513291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.513875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.514183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.514450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.516380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:40.528232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.529805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.542070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1117/2214] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:40.553838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:40.568082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7fdf2-1266-458b-b45f-90cfcae9c0f5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:40.573219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:40.573979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:40.574616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:40.575087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] PATH_INFO: `/v3/users/c237e219ae4947d296a60173faa21753` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:40.576422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c237e219ae4947d296a60173faa21753)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:40.579061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:40.631871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c237e219ae4947d296a60173faa21753'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:40.640098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c237e219ae4947d296a60173faa21753'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:40.653517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c237e219ae4947d296a60173faa21753'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:40.654231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c237e219ae4947d296a60173faa21753'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:40.654894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ae27e7e-53bb-4c2a-942e-616cc7bf29b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c237e219ae4947d296a60173faa21753'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:40.668404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1098/2215] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:26:40 2022] DELETE /identity/v3/users/c237e219ae4947d296a60173faa21753 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:41.152763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.163575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670c748-1bf5-4ffc-9127-3efa96148f36 service placement] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.229063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.229688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.229991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.230258 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] PATH_INFO: `/v3/projects/57bc52b03f3544bcbc82320136ff3c0d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.231449 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bc52b03f3544bcbc82320136ff3c0d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.233355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.282404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bc52b03f3544bcbc82320136ff3c0d', 'request_id': 'req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:41.290227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bc52b03f3544bcbc82320136ff3c0d', 'request_id': 'req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:41.296455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bc52b03f3544bcbc82320136ff3c0d', 'request_id': 'req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:41.307161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] The token cache is being invalidate because project 57bc52b03f3544bcbc82320136ff3c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:26:41.307442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:41.308080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c8fdd32b-dca1-4001-bf6e-b4fdeb2ebbdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:26:41.309806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1118/2216] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:26:41 2022] DELETE /identity/v3/projects/57bc52b03f3544bcbc82320136ff3c0d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:41.315392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.315677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.315946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.339493 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:41.340700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:41.401436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1099/2217] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:26:41.409426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.409709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.410004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.429486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:41.430715 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:41.440556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1119/2218] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:41.445289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.455253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4056372-d621-4eb3-b980-da95a77214d7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.459951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.460546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.460821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.461156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.461744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:26:41.462057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.463645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.478610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1100/2219] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:26:41.479758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.491632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf1ff-73eb-48c7-8deb-356c40d51505 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.497374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.498089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.498271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.498536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.499148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.501234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.532419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1120/2220] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:41.534885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.545327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3f458-3123-4473-9b93-32325b203c15 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.594791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:41.606439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.607071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.607374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.607650 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.608270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.610255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.633064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1101/2221] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:41 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:41.637051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.649069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aac2b3-48af-4dae-b25e-e31f37aff6c9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.653880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.654573 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.654849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.655120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.655945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.658967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.671138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1121/2222] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:26:41.675659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.685698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e45229-7692-4377-b645-d6468c925a26 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.690393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.691016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.691291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.691557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.692195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.693767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da922-6703-432c-a70f-d41b51b432ac admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.703979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1102/2223] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:41.708289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.718356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00686-245d-43ff-85f4-3b1c6e08e91d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.723417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.724057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.724328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.724592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] PATH_INFO: `/v3/projects/fd034552dfeb488592e546185a421515/users/14a26414025b4560b13fb9d741a2d7be/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.740021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd034552dfeb488592e546185a421515, user_id=14a26414025b4560b13fb9d741a2d7be, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.742703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.755326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1122/2224] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:41 2022] PUT /identity/v3/projects/fd034552dfeb488592e546185a421515/users/14a26414025b4560b13fb9d741a2d7be/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:41.761412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392709-6dce-434a-83e8-cf29308906e5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.761771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392709-6dce-434a-83e8-cf29308906e5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.762205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392709-6dce-434a-83e8-cf29308906e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.780950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-78392709-6dce-434a-83e8-cf29308906e5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:41.782242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-78392709-6dce-434a-83e8-cf29308906e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:41.842606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1103/2225] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:41.852678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:41.854447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:41.869393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:41.914050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc620e-5687-4ce0-893f-d2dc91fb6ed9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:41.917700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:41.918330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:41.918938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:41.918938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:41.927918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:41.929331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:41.939029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1123/2226] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:46.551018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.551565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.551565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.582495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] MFA Rules not processed for user `14a26414025b4560b13fb9d741a2d7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:46.583708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:46.657406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1104/2227] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:46.661843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.674194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c648-adbf-4fe5-ad21-e49c83eb3699 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.679189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.679871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.680210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.680536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.681224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.683217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.714496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1124/2228] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:26:46 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:26:46.718272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.729349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b6bb8-656e-4844-82f4-98f4fcec2271 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.794506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.795121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.795398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.795668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.796296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.798219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.808133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:46.821738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1105/2229] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:26:46 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:26:46.825611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.836366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50f5a-b75b-4264-9e02-e7f3cb269ff8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.841004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.841600 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.841952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.842312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.842903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.844389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.856013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1125/2230] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:26:46.860417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.871881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada7f02-e6d9-4cf2-9439-9c4f2973b150 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.878707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.878707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.878707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.878707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] PATH_INFO: `/v3/projects/76a3ffff55744ae89b89d1de82816c47/users/d257687f42fa46158ec50cb8fe0598ac/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.896492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a3ffff55744ae89b89d1de82816c47, user_id=d257687f42fa46158ec50cb8fe0598ac, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.899173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.912253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1106/2231] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:46 2022] PUT /identity/v3/projects/76a3ffff55744ae89b89d1de82816c47/users/d257687f42fa46158ec50cb8fe0598ac/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:46.916308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:46.926772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50c50b-19fa-46f8-b8fb-9e12335d7fdf admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:46.981276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:46.981922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:46.982184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:46.982452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:46.983080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:46.984665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db361-e302-444f-bda1-a14fc55607e5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:46.995135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1126/2232] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:26:46.999254 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:47.009521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aff01-ad31-4993-a5ac-4f5a5bf9fc6d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:47.014161 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:47.014801 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:47.015077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:47.015347 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] PATH_INFO: `/v3/projects/76a3ffff55744ae89b89d1de82816c47/users/d257687f42fa46158ec50cb8fe0598ac/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:47.017564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a3ffff55744ae89b89d1de82816c47, user_id=d257687f42fa46158ec50cb8fe0598ac, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:47.020418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:47.031049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1107/2233] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:26:46 2022] PUT /identity/v3/projects/76a3ffff55744ae89b89d1de82816c47/users/d257687f42fa46158ec50cb8fe0598ac/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:26:51.708262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:51.709650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:51.710421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:51.743733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] MFA Rules not processed for user `d257687f42fa46158ec50cb8fe0598ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:26:51.745036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:51.824235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1127/2234] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:26:51.834587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:51.836376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:51.925231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e475e-293d-4e92-a654-53eacb3224f5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:51.931162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:51.931895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:51.932251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:51.932593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:52.005699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:52.007327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:52.017196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1108/2235] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:26:55.382045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:26:55.392911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:26:55.398410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf783ef-ac86-4cc4-9f06-753c41560019 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:26:55.405295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:26:55.405927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:26:55.406193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:26:55.406456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:26:55.408221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:26:55.488993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:26:55.490665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:26:55.501232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1128/2236] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:00.769239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:00.771319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:00.806584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2d581-77fa-42d6-af7f-4346209c5053 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:00.815617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:00.816566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:00.817047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:00.825466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:00.831301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:00.852277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:00.854560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8954a53-c036-4a11-9898-648d9ce237b8 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:00.875191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1109/2237] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:05.502978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=26 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:05.836137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:05.847743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c762e6c-4862-4ed1-bf0c-597a6d1b7524 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:05.853460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:05.854439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:05.854810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:05.855170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:05.857425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:05.934506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:05.936359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:05.946792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1129/2238] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:10.864291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=4,keystone:SELECT=79 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:14.296862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e650-08e4-4f8e-b135-ef0bf5a9b877 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:14.297478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e650-08e4-4f8e-b135-ef0bf5a9b877 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:14.297478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10e650-08e4-4f8e-b135-ef0bf5a9b877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:14.319087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ba10e650-08e4-4f8e-b135-ef0bf5a9b877 None None] MFA Rules not processed for user `7bd39d1cce924d77979ded850bbfbea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:14.320291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ba10e650-08e4-4f8e-b135-ef0bf5a9b877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:14.328174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1110/2239] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:14.656046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:14.657510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:14.718730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b8947-ce2b-4253-a1f5-40824af6723b service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:14.722273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:14.722874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:14.723148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:14.723416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:14.725133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:14.735688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:14.737300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbb55e-dff5-4a8f-886c-f939daf274fc service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:14.749798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1130/2240] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:17.196949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:17.197572 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:17.197572 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:17.219367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] MFA Rules not processed for user `14a26414025b4560b13fb9d741a2d7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:17.221120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:17.228830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1111/2241] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:17.381006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:17.381633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:17.382868 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:17.422853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] MFA Rules not processed for user `e002e42dfdf446b49fd421f55c8cee25`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:27:17.424801 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:17.521187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1131/2242] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:27:23.845491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:23.858721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d52340-848c-4a6e-a8b4-19876a3f5dd7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:23.864719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:23.865439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:23.865720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:23.866016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:23.867887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:23.945037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:23.947056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:23.961813 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1112/2243] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:25.388107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:25.401636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529972-c635-4ef1-962a-b82f196b4f7c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:25.407572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:25.408173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:25.408446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:25.408902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:25.410632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:27:25.423345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:25.424926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:25.436119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1132/2244] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:33.955431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=34 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:35.431755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=85 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:27:43.971779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:27:43.981036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19115c38-8ece-434c-bdce-36d38e79cd5f service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:27:43.984677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:27:43.985271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:27:43.985545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:27:43.985811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:27:43.994517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:27:43.995918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:27:44.005712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1113/2245] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:27:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:27:54.001269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:08.599840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:08.620411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88f3-6a5f-42ed-9d36-4f0d017be570 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:08.624012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:08.624613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:08.624888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:08.625157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:08.626907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:08.739838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:08.741268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:08.759933 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1133/2246] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:11.763299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:11.764844 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:11.830786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:11.832576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:11.851999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309768-8948-405b-8d29-4c2d093404ac service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:11.858361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:11.859299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:11.859746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:11.860163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] PATH_INFO: `/v3/users/c2d6b067b6c24b53957ef39d3d00242b` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:11.861348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d6b067b6c24b53957ef39d3d00242b)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:11.863373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:11.917479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d6b067b6c24b53957ef39d3d00242b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:11.925930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d6b067b6c24b53957ef39d3d00242b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:11.927419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a0a8-ddac-471b-b2c1-55beddd9e5d3 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:11.932802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:11.933412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:11.933684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:11.933980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:11.935677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:11.939161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d6b067b6c24b53957ef39d3d00242b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:11.946048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d6b067b6c24b53957ef39d3d00242b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:11.946786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d6b067b6c24b53957ef39d3d00242b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:11.947834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:11.948167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:11.949808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91938-a848-4584-b6e9-74a51d7ab80e service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:11.956345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1134/2247] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:11 2022] DELETE /identity/v3/users/c2d6b067b6c24b53957ef39d3d00242b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:11.962164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1114/2248] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:12.136048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.137517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:12.201830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a74aa-b776-4d76-bd1b-8593645fddb2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.206359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.206968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.207241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.207507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] PATH_INFO: `/v3/projects/69492e94802e4f43b8c3da76220beb4d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.208597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69492e94802e4f43b8c3da76220beb4d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.210537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.255210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69492e94802e4f43b8c3da76220beb4d', 'request_id': 'req-45391959-5075-4e7a-973c-a661a50dab12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:12.262677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69492e94802e4f43b8c3da76220beb4d', 'request_id': 'req-45391959-5075-4e7a-973c-a661a50dab12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:12.269131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69492e94802e4f43b8c3da76220beb4d', 'request_id': 'req-45391959-5075-4e7a-973c-a661a50dab12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:12.279349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] The token cache is being invalidate because project 69492e94802e4f43b8c3da76220beb4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:28:12.279629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:12.280240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45391959-5075-4e7a-973c-a661a50dab12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:12.282412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1135/2249] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:12 2022] DELETE /identity/v3/projects/69492e94802e4f43b8c3da76220beb4d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:12.287466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.287776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.288147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.345820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:12.346982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:12.395551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:12.403988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1115/2250] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:28:12.413396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.413675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.413974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.433820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:12.435026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:12.443099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1136/2251] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:12.447103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.456606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95018a70-20d5-421f-9698-e09e36d6bf8c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.461047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.461629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.461925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.462201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.462830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:28:12.463130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.464692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.476386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1116/2252] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:28:12.480376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.490057 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af539754-6e34-4147-82ae-0c9c5245e06b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.494631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.495211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.495579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.495852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.496472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.498395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.525567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1137/2253] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:12.529612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.540045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc9f3-908b-4854-a849-62ef8f421d40 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.595078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.595719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.596101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.596267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.596993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.598930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.619977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1117/2254] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:28:12.624092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.634296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296188f-03f9-4339-97c8-519133ab2f4d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.638842 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.639431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.639703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.640545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.641342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.643130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.652774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1138/2255] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:12.657099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.666964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873844-8133-453a-9f66-61312a70d273 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.671546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.672128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.672407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.672677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.673307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.674955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5da05-ddbf-4f53-aee3-9427cefeeef2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.685290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1118/2256] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:28:12.689297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.699400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd526e-32f9-4835-9f09-733013d223eb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.704497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.705129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.705399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.705681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] PATH_INFO: `/v3/projects/4deb94bc191f496a8ba80dea6f684de3/users/93debd3b555046c79e42f8b9ff091cd8/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.720193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4deb94bc191f496a8ba80dea6f684de3, user_id=93debd3b555046c79e42f8b9ff091cd8, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.722852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.734800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1139/2257] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:12 2022] PUT /identity/v3/projects/4deb94bc191f496a8ba80dea6f684de3/users/93debd3b555046c79e42f8b9ff091cd8/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:28:12.744876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.745189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.745462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.772337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] MFA Rules not processed for user `93debd3b555046c79e42f8b9ff091cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:12.773537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:12.836617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1119/2258] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:12.841293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.868080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:12.904701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449188-f68e-45f2-8eb1-c21f7a66f0ef admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:12.909952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:12.910548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:12.910817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:12.911081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:12.911698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:12.913577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:12.938862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1140/2259] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:12.943054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:12.954217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7a65f-ec89-4f82-ad25-1c326af866bd None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.003098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:13.010999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.011593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.011867 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.012132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.012745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.014761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.035543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1120/2260] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:28:12 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:28:13.039738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.049794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30427e9-f2be-4efb-8656-fa9f2aa5b9ae admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.054397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.054983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.055260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.055529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.056171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.057811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.068554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1141/2261] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:13.072433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.082909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c45-57de-4124-aa95-38a76d2ffaa5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.087547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.088179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.088451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.088717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] PATH_INFO: `/v3/projects/23f4c1acad594ee583c0ea00bf484689/users/c07791822eb94b46b765337b1ae17679/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.104445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f4c1acad594ee583c0ea00bf484689, user_id=c07791822eb94b46b765337b1ae17679, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.107134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.120055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1121/2262] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:13 2022] PUT /identity/v3/projects/23f4c1acad594ee583c0ea00bf484689/users/c07791822eb94b46b765337b1ae17679/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:13.123735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.137559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca5fb-af8a-4eb2-abd4-753d63ce5805 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.201531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.202173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.203000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.203280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.203910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.205519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7301f-a0de-41a3-9346-c3feaf94ac85 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.215559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1142/2263] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:28:13.220371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.231368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f49d2-1e9f-42e4-8f4c-7b64bb69904a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.236008 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.236645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.236918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.237184 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] PATH_INFO: `/v3/projects/23f4c1acad594ee583c0ea00bf484689/users/c07791822eb94b46b765337b1ae17679/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.239058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f4c1acad594ee583c0ea00bf484689, user_id=c07791822eb94b46b765337b1ae17679, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.241667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.252352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1122/2264] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:28:13 2022] PUT /identity/v3/projects/23f4c1acad594ee583c0ea00bf484689/users/c07791822eb94b46b765337b1ae17679/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:28:13.262505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.262817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.263097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.291202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] MFA Rules not processed for user `c07791822eb94b46b765337b1ae17679`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:13.292469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:13.358220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1143/2265] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:13.369523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.371367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:13.427804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb105c8-c350-4c91-b012-ab8cd23fbd78 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.431370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.431955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.432223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.432481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.441696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.443115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.452091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1123/2266] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:13.526633 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:13.536067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71104cbf-a7a8-4887-95ed-43375690b7ad None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:13.539683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:13.540270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:13.540544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:13.540808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:13.557767 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:13.597823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:13.599278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72c7f1-31d7-4c35-80e3-9abbd5c5b4d4 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:13.608345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1144/2267] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:23.448044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:23.604380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=19 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:47.576108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:47.578628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:47.665223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9d283-48e4-4a4c-905f-50430e077f05 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:47.671236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:47.671888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:47.672189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:47.672590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:47.674328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:47.686243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:47.687752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:47.698717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1124/2268] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:28:50.343522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d1b3-441a-437c-aec5-0779d0ecbd5e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:50.344029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d1b3-441a-437c-aec5-0779d0ecbd5e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:50.344147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d1b3-441a-437c-aec5-0779d0ecbd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:50.363003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-57e9d1b3-441a-437c-aec5-0779d0ecbd5e None None] MFA Rules not processed for user `5ce6653be14c4cd1b25ef3fe20739c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:50.364186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-57e9d1b3-441a-437c-aec5-0779d0ecbd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:50.417534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1145/2269] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:57.694185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=32 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:28:59.364276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:59.424530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1731-9c5d-47d7-bbd1-3332ca29a976 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:59.428888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:59.429496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:59.429774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:59.430073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] PATH_INFO: `/v3/users/93debd3b555046c79e42f8b9ff091cd8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:59.431159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93debd3b555046c79e42f8b9ff091cd8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:59.433043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:59.477707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93debd3b555046c79e42f8b9ff091cd8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:59.485193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93debd3b555046c79e42f8b9ff091cd8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:59.496884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93debd3b555046c79e42f8b9ff091cd8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:59.497511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93debd3b555046c79e42f8b9ff091cd8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:59.498148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93debd3b555046c79e42f8b9ff091cd8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:28:59.511589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1125/2270] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:28:59 2022] DELETE /identity/v3/users/93debd3b555046c79e42f8b9ff091cd8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:28:59.517090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754575-9307-429a-a32d-51713debdaa7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:59.517545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754575-9307-429a-a32d-51713debdaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:59.517657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754575-9307-429a-a32d-51713debdaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:59.535889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-13754575-9307-429a-a32d-51713debdaa7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:28:59.537273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-13754575-9307-429a-a32d-51713debdaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:59.594970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1146/2271] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:28:59.604500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:59.605870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:59.683127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eae77-2418-4a06-8ae9-aaf0ce673630 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:59.686667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:59.687260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:59.688107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:59.688375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:59.697225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:28:59.698668 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:28:59.708423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1126/2272] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:28:59.974809 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754575-9307-429a-a32d-51713debdaa7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:28:59.976248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-13754575-9307-429a-a32d-51713debdaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:28:59.991513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13754575-9307-429a-a32d-51713debdaa7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:28:59.996409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:28:59.997711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:28:59.998036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:28:59.998310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] PATH_INFO: `/v3/projects/4deb94bc191f496a8ba80dea6f684de3` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:28:59.999427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4deb94bc191f496a8ba80dea6f684de3)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.001930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.062102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4deb94bc191f496a8ba80dea6f684de3', 'request_id': 'req-d199a109-c152-495e-a56c-40a7e930afff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.070603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4deb94bc191f496a8ba80dea6f684de3', 'request_id': 'req-d199a109-c152-495e-a56c-40a7e930afff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.077102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4deb94bc191f496a8ba80dea6f684de3', 'request_id': 'req-d199a109-c152-495e-a56c-40a7e930afff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.087909 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] The token cache is being invalidate because project 4deb94bc191f496a8ba80dea6f684de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:00.088195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.088830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.090356 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1147/2273] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:28:59 2022] DELETE /identity/v3/projects/4deb94bc191f496a8ba80dea6f684de3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:00.094405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.099262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:00.106145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0b859-e832-4df2-a938-ce28d41e0240 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.176540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.177182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.177458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.177831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] PATH_INFO: `/v3/users/c07791822eb94b46b765337b1ae17679` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.179069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07791822eb94b46b765337b1ae17679)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.181034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.232648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07791822eb94b46b765337b1ae17679'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.241585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07791822eb94b46b765337b1ae17679'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.255935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07791822eb94b46b765337b1ae17679'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.256659 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07791822eb94b46b765337b1ae17679'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.257263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5ba5a97e-0beb-44a6-9f20-2e4cdcdbb9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07791822eb94b46b765337b1ae17679'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.270302 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1127/2274] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:00 2022] DELETE /identity/v3/users/c07791822eb94b46b765337b1ae17679 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:00.556229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.557744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:00.570829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a109-c152-495e-a56c-40a7e930afff admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.599675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:00.634297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.634929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.635205 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.635471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] PATH_INFO: `/v3/projects/23f4c1acad594ee583c0ea00bf484689` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.636576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f4c1acad594ee583c0ea00bf484689)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.638541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.687885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f4c1acad594ee583c0ea00bf484689', 'request_id': 'req-07d339fb-c4d0-45a5-9092-b858a976c03d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.695262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f4c1acad594ee583c0ea00bf484689', 'request_id': 'req-07d339fb-c4d0-45a5-9092-b858a976c03d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.701895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f4c1acad594ee583c0ea00bf484689', 'request_id': 'req-07d339fb-c4d0-45a5-9092-b858a976c03d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.713386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] The token cache is being invalidate because project 23f4c1acad594ee583c0ea00bf484689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:00.713669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.714344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-07d339fb-c4d0-45a5-9092-b858a976c03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:00.715841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1148/2275] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:00 2022] DELETE /identity/v3/projects/23f4c1acad594ee583c0ea00bf484689 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:00.722354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.722833 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.722928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.742885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:00.744000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:00.802911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1128/2276] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:00.811761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.812041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.812311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.832841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:00.834058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:00.842332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1149/2277] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:00.847401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.857214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d297fcf-9d37-47f0-9084-22f3fc9bc7c9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.861917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.862514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.862793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.863057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.863719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:00.864015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.865617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.880774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1129/2278] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:00.882148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.892684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799632-ecde-4d7b-9d07-ab48288a75c7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.897315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:00.897917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:00.898285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:00.898550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:00.899167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:00.901046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:00.928616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1150/2279] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:00.932814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:00.942933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9c26-c6d3-4048-ab0b-302d5289bdb3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:00.947499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:01.002623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.003135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.003421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.003703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.004309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.006249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.028061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1130/2280] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:00 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:01.032420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.042605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b5d5b-c038-4db9-9294-83dc28ed4ce5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.047360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.047955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.048232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.048499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.049156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.050784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.060634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1151/2281] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:01.064918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.074644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3a45-85b2-44de-8b9f-5629e5b73db8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.080116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.080720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.080999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.081269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.081929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.083562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c2bf8-fb98-430d-82ca-e21cd5f237a7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.094204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1131/2282] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:01.098287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.108299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944c7b8-7a66-4daa-85c8-4174af288238 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.113106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.113775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.114087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.114354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] PATH_INFO: `/v3/projects/3ce14499451447c2b46c29ac4107c8b7/users/f61703322fc4428d8646bd8cb58966a9/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.129333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce14499451447c2b46c29ac4107c8b7, user_id=f61703322fc4428d8646bd8cb58966a9, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.132424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.146246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1152/2283] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:01 2022] PUT /identity/v3/projects/3ce14499451447c2b46c29ac4107c8b7/users/f61703322fc4428d8646bd8cb58966a9/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:01.157619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.157933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.158197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.184933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] MFA Rules not processed for user `f61703322fc4428d8646bd8cb58966a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:01.186158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.249831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1132/2284] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:01.255250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.312971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:01.319256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4dadf-22cc-4816-9c0c-fa34b6ade6c0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.325555 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.326271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.326792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.327375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.328792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.331079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.360303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1153/2285] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:01.364660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.376618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a773820-16c2-40b8-a277-a8fb4d9a471a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.438526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.439209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.439512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.439853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.440538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.442555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.465948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1133/2286] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:01.469733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.479946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712228e-1679-47c4-9eaa-7b4a1cfa016f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.484897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.485507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.486257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.486257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.486736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.488347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.505286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1154/2287] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:01.509442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.525074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba134-dec3-4d29-8a7d-c0784a14abbc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.529838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.530647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.530931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.531854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] PATH_INFO: `/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62/users/4e156ad2b2d34bbab7a230542f881bbb/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.534413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:01.549503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7d8a947ca24aa3b15b8b9bdf47bd62, user_id=4e156ad2b2d34bbab7a230542f881bbb, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.552199 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.564945 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1134/2288] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:01 2022] PUT /identity/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62/users/4e156ad2b2d34bbab7a230542f881bbb/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:01.568903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.579458 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b323f2b-cf49-403d-93a3-bfea18424926 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.633706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.634373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.634652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.634914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.635538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.637225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084524-012f-4b79-a731-d99b240ba36c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.647830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1155/2289] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:01.652080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.662796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b63a9-e1e6-4ae7-93a7-d0173aa46a5f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.667404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.668139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.668423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.668878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] PATH_INFO: `/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62/users/4e156ad2b2d34bbab7a230542f881bbb/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.670812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7d8a947ca24aa3b15b8b9bdf47bd62, user_id=4e156ad2b2d34bbab7a230542f881bbb, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.673530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.683777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1135/2290] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:01 2022] PUT /identity/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62/users/4e156ad2b2d34bbab7a230542f881bbb/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:01.694089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.694373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.694643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.722980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] MFA Rules not processed for user `4e156ad2b2d34bbab7a230542f881bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:01.724379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.791386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1156/2291] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:01.802355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.804098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:01.881569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0403fdf-d512-423d-b777-95035e447ece admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:01.885476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:01.886108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:01.886383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:01.886649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:01.897193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:01.898775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ba3ff-bee1-4168-b3a1-996889d9ad13 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:01.908543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1136/2292] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:01.938353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:01.989665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.003593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbb49-cf3a-476d-8485-ea76a8c9be66 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.008351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.008983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.009265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.009536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] PATH_INFO: `/v3/users/f61703322fc4428d8646bd8cb58966a9` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.010706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61703322fc4428d8646bd8cb58966a9)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.012647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.063300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61703322fc4428d8646bd8cb58966a9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.071944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61703322fc4428d8646bd8cb58966a9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.084587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61703322fc4428d8646bd8cb58966a9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.091331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61703322fc4428d8646bd8cb58966a9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.091965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61703322fc4428d8646bd8cb58966a9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.097943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1157/2293] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:01 2022] DELETE /identity/v3/users/f61703322fc4428d8646bd8cb58966a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:02.102366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.102649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.102917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.121845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:02.123165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.180558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1137/2294] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:02.190843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.192256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.247820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959df722-7096-4d55-9fb3-dcccfa2ee7c9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.252172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.252766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.253043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.253311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.262090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.263488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.272916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1158/2295] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:02.759593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.761218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:02.775539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8a9a2-0f7d-4995-a10e-69ca9ec4e866 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.782811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.783444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.783724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.783992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] PATH_INFO: `/v3/projects/3ce14499451447c2b46c29ac4107c8b7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.785108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce14499451447c2b46c29ac4107c8b7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.787172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.833682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.834750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce14499451447c2b46c29ac4107c8b7', 'request_id': 'req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.843770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce14499451447c2b46c29ac4107c8b7', 'request_id': 'req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.851174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce14499451447c2b46c29ac4107c8b7', 'request_id': 'req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.869176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] The token cache is being invalidate because project 3ce14499451447c2b46c29ac4107c8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:02.869460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.870126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:02.871628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1138/2296] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:02 2022] DELETE /identity/v3/projects/3ce14499451447c2b46c29ac4107c8b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:02.876426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:02.886480 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72cc5-4b22-4994-bec6-5538ccbb9b95 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:02.942260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:02.942900 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:02.943173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:02.943597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] PATH_INFO: `/v3/users/4e156ad2b2d34bbab7a230542f881bbb` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:02.944814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e156ad2b2d34bbab7a230542f881bbb)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:02.946748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:02.959673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:02.992738 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e156ad2b2d34bbab7a230542f881bbb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.001182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e156ad2b2d34bbab7a230542f881bbb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.012811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e156ad2b2d34bbab7a230542f881bbb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.019894 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e156ad2b2d34bbab7a230542f881bbb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.020470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-3bb30b2c-add9-4380-8313-0a22fa58d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e156ad2b2d34bbab7a230542f881bbb'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.026142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1159/2297] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:02 2022] DELETE /identity/v3/users/4e156ad2b2d34bbab7a230542f881bbb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.305825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.307970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.328710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac3b0-388c-4cdb-bcdd-7c8b4dbe09d3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.388509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.389142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.389684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.389984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] PATH_INFO: `/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.391154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7d8a947ca24aa3b15b8b9bdf47bd62)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.393119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.445847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7d8a947ca24aa3b15b8b9bdf47bd62', 'request_id': 'req-65260ac1-aa49-4961-99f6-7d0cd16ad37a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.453758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7d8a947ca24aa3b15b8b9bdf47bd62', 'request_id': 'req-65260ac1-aa49-4961-99f6-7d0cd16ad37a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.463245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7d8a947ca24aa3b15b8b9bdf47bd62', 'request_id': 'req-65260ac1-aa49-4961-99f6-7d0cd16ad37a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.474501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] The token cache is being invalidate because project db7d8a947ca24aa3b15b8b9bdf47bd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:03.474790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.475450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65260ac1-aa49-4961-99f6-7d0cd16ad37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:03.476971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1139/2298] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:03 2022] DELETE /identity/v3/projects/db7d8a947ca24aa3b15b8b9bdf47bd62 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.481728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.482044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.482296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.502269 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.503469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.564734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1160/2299] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:03.572236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.572584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.572929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.593297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.595204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:03.604010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1140/2300] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:03.608151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.617937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b77d8-a668-457e-ba4d-5e97e61ac0df None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.622491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.623149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.623422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.623684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.624326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:03.624712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.626364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.638756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1161/2301] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:03.644170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.654471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887232d0-8d06-4433-953c-f86d341c0431 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.660153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.660760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.661051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.661303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.661958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.663828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.695649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1141/2302] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:03.699763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.710207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e0f8-eabb-443b-a4fb-f6d01525a3d6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.766826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.767427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.767702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.767968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.768576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.770562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.795146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1162/2303] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:03.796390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.808061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a417-5cb7-412d-87b7-6616cdebe5de admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.812670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.813266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.813541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.813808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.814475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.816101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.825743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1142/2304] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:03.830643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.841042 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8888d7-30af-4609-890d-65fcfde46e27 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.846416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.847016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.847291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.847556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.848191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.849778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8f05-62a8-451c-bbc6-a34558b8903b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.852393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:03.866410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1163/2305] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:03.867870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:03.878138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f4c8d-77c3-4196-8dbe-e8582368b80e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:03.883376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:03.888089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.888089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.888089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] PATH_INFO: `/v3/projects/25e6d9bc64324a1d887595fd3e0c5387/users/a1fa31ff4476429098717ea24d173aea/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.902252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e6d9bc64324a1d887595fd3e0c5387, user_id=a1fa31ff4476429098717ea24d173aea, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:03.904894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:03.918513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1143/2306] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:03 2022] PUT /identity/v3/projects/25e6d9bc64324a1d887595fd3e0c5387/users/a1fa31ff4476429098717ea24d173aea/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:03.930454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:03.930936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:03.931055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:03.958262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] MFA Rules not processed for user `a1fa31ff4476429098717ea24d173aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:03.959454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:04.022670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1164/2307] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:04.027132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.031513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:04.088366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d062980-2ebd-48f4-8422-43105a338381 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.092840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.093428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.093701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.093999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.094598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.096457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.121350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1144/2308] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:04 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:04.125963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.136852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f157ab-7429-45c9-8af2-d1107a2b5925 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.192145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.192744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.193018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.193282 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.193923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.195853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.216897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1165/2309] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:04 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:04.220893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.230926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb022d-ffd0-4ad9-b709-a8988d814863 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.235716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716768-9485-4408-ac09-210586253871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.236247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716768-9485-4408-ac09-210586253871 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.236520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716768-9485-4408-ac09-210586253871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.236786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf716768-9485-4408-ac09-210586253871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.237409 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716768-9485-4408-ac09-210586253871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.238998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf716768-9485-4408-ac09-210586253871 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.249299 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1145/2310] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:04.253856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.263570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27f7f-9458-4760-ba8f-da26a34a3086 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.268908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.269542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.269818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.270186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] PATH_INFO: `/v3/projects/b49f56c57a5f4c15bb70875146e693e4/users/fb98dd5bc3684df29267eccfee3c9469/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.284707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49f56c57a5f4c15bb70875146e693e4, user_id=fb98dd5bc3684df29267eccfee3c9469, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.287425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.300401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1166/2311] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:04 2022] PUT /identity/v3/projects/b49f56c57a5f4c15bb70875146e693e4/users/fb98dd5bc3684df29267eccfee3c9469/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:04.304354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716768-9485-4408-ac09-210586253871 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.314791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf716768-9485-4408-ac09-210586253871 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.369517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.370084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.370363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.370636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.371263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.372837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e78491-aaa9-4caf-9dfc-c01901c4ccca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.384016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1146/2312] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:04.388171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.399225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a70ae-a908-406c-9a55-f84a4e5bc0bc admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.403920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.404566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.404841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.405104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] PATH_INFO: `/v3/projects/b49f56c57a5f4c15bb70875146e693e4/users/fb98dd5bc3684df29267eccfee3c9469/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.407056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49f56c57a5f4c15bb70875146e693e4, user_id=fb98dd5bc3684df29267eccfee3c9469, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.409674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.419846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1167/2313] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:04 2022] PUT /identity/v3/projects/b49f56c57a5f4c15bb70875146e693e4/users/fb98dd5bc3684df29267eccfee3c9469/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:04.430526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.430937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.431217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.459235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] MFA Rules not processed for user `fb98dd5bc3684df29267eccfee3c9469`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:04.460550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:04.522681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:04.528390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1147/2314] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:04.539591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.541300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:04.585524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:04.599319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c167-3eba-4875-bf70-37b0205cdba9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.602934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.603525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.603790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.604048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.613211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.614655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.623831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1168/2315] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:04.707681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:04.717234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062666e-b911-4c7d-a730-d8a07d96ea30 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:04.721669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:04.722301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:04.722576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:04.722847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:04.784283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:04.785736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79d94-b6d6-4d5e-92a2-f6ec0e8daa29 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:04.795446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1148/2316] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:09.675891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:09.735683 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d316ff-7996-4d35-a66f-81ed677a7f0a service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:09.740163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:09.740773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:09.741044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:09.741308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] PATH_INFO: `/v3/users/a1fa31ff4476429098717ea24d173aea` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:09.742413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fa31ff4476429098717ea24d173aea)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:09.744337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:09.789336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fa31ff4476429098717ea24d173aea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:09.796293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fa31ff4476429098717ea24d173aea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:09.808733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fa31ff4476429098717ea24d173aea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:09.816130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fa31ff4476429098717ea24d173aea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:09.816763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fa31ff4476429098717ea24d173aea'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:09.822505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1169/2317] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:09 2022] DELETE /identity/v3/users/a1fa31ff4476429098717ea24d173aea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:09.826973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:09.827447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:09.827600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:09.845725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:09.846940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:09.905450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1149/2318] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:09.915093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:09.916579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:09.973105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5773-3d61-4ba3-bd0b-6fa95759692e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:09.976995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:09.977595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:09.977867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:09.978155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:09.987611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:09.989019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:09.998221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1170/2319] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:10.262014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:10.263447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:10.275856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cff3-7d1a-4f5f-9772-7d7c9793b891 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:10.281222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:10.282070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:10.282353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:10.282620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] PATH_INFO: `/v3/projects/25e6d9bc64324a1d887595fd3e0c5387` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:10.283763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e6d9bc64324a1d887595fd3e0c5387)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:10.285652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:10.334469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e6d9bc64324a1d887595fd3e0c5387', 'request_id': 'req-f4d2c72a-d078-4214-b39a-3f39f45bb220'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.341017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e6d9bc64324a1d887595fd3e0c5387', 'request_id': 'req-f4d2c72a-d078-4214-b39a-3f39f45bb220'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.348513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e6d9bc64324a1d887595fd3e0c5387', 'request_id': 'req-f4d2c72a-d078-4214-b39a-3f39f45bb220'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.358555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] The token cache is being invalidate because project 25e6d9bc64324a1d887595fd3e0c5387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:10.358845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.359480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.360954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1150/2320] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:10 2022] DELETE /identity/v3/projects/25e6d9bc64324a1d887595fd3e0c5387 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:10.364911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:10.371140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:10.375072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896f11-fecf-4ea4-86a9-59b949f886b2 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:10.432887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:10.433532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:10.433812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:10.434110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] PATH_INFO: `/v3/users/fb98dd5bc3684df29267eccfee3c9469` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:10.435219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb98dd5bc3684df29267eccfee3c9469)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:10.437156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:10.481517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb98dd5bc3684df29267eccfee3c9469'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.488903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb98dd5bc3684df29267eccfee3c9469'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.501018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb98dd5bc3684df29267eccfee3c9469'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.507919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb98dd5bc3684df29267eccfee3c9469'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.508549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6d4afb6b-62b0-4695-90ec-565e30995a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb98dd5bc3684df29267eccfee3c9469'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.514228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1171/2321] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:10 2022] DELETE /identity/v3/users/fb98dd5bc3684df29267eccfee3c9469 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:10.789807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:10.791279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:10.807430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2c72a-d078-4214-b39a-3f39f45bb220 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:10.825417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:10.867236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:10.867850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:10.868078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:10.868351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] PATH_INFO: `/v3/projects/b49f56c57a5f4c15bb70875146e693e4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:10.869481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49f56c57a5f4c15bb70875146e693e4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:10.871445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:10.917823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49f56c57a5f4c15bb70875146e693e4', 'request_id': 'req-24db082b-32f8-4b39-93fa-32bf47c61e16'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.923851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49f56c57a5f4c15bb70875146e693e4', 'request_id': 'req-24db082b-32f8-4b39-93fa-32bf47c61e16'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.930877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49f56c57a5f4c15bb70875146e693e4', 'request_id': 'req-24db082b-32f8-4b39-93fa-32bf47c61e16'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.941632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] The token cache is being invalidate because project b49f56c57a5f4c15bb70875146e693e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:10.941928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.942614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-24db082b-32f8-4b39-93fa-32bf47c61e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:10.944052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1151/2322] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:10 2022] DELETE /identity/v3/projects/b49f56c57a5f4c15bb70875146e693e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:10.948976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:10.949438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:10.949534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:10.968880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:10.970080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.027031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1172/2323] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:11.034538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.034824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.035094 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.053919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:11.055100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.063341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1152/2324] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:11.067332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.076731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad788f-4733-4165-b547-74de4fcb8b8e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.081925 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.082531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.082805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.083066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.083698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:11.083993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.085626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.096912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1173/2325] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:11.100991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.110944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411edbb-09b4-4125-aed7-cf7e20d0bf5f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.115626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.116213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.116552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.116820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.117492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.119346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.147089 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1153/2326] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:11.151137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.160995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7020b2-817e-462c-a63b-0004273474f0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.168501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:11.218993 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.219611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.219883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.220151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.220796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.222815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.244891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1174/2327] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:11.249216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.260086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e09f-cbf6-4764-9afa-31a72ef6bdeb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.268006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.268591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.268868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.269133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.269882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.271487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.281126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1154/2328] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:11.285177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.295002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aadc25-c081-4df3-a98a-9780ae309817 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.300216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.300795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.301071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.301337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.302004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.303584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ee012-a212-4a0e-a256-67910c2b8e07 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.314524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1175/2329] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:11.318419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.328269 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4749dc3-e466-4df8-b0ea-8b79ef6271e3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.332814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.333443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.333715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.334012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] PATH_INFO: `/v3/projects/1434b6f9158349c29e513bc58203c0fa/users/a0217beca49a41a69256d03984193e1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.348289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1434b6f9158349c29e513bc58203c0fa, user_id=a0217beca49a41a69256d03984193e1d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.350975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.364248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1155/2330] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:11 2022] PUT /identity/v3/projects/1434b6f9158349c29e513bc58203c0fa/users/a0217beca49a41a69256d03984193e1d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:11.376133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.376348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.376615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.404928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] MFA Rules not processed for user `a0217beca49a41a69256d03984193e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:11.406255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.470059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1176/2331] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:11.481148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.483025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.534730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:11.540953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c6fc2-062f-4bc5-9927-1715ea2fcdd4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.545620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.546248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.547103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.547397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.555544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.556943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6198-795a-4867-83c7-7558255a73d9 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.565640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1156/2332] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:11.584349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.646584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aeb80-32e4-486d-971b-ecde731e2ce4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.651065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.651682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.651959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.652228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] PATH_INFO: `/v3/users/a0217beca49a41a69256d03984193e1d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.653343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0217beca49a41a69256d03984193e1d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.655307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.676892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:11.701861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0217beca49a41a69256d03984193e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.709493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0217beca49a41a69256d03984193e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.721181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0217beca49a41a69256d03984193e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.727862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0217beca49a41a69256d03984193e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.728510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0217beca49a41a69256d03984193e1d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:11.734271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1177/2333] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:11 2022] DELETE /identity/v3/users/a0217beca49a41a69256d03984193e1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:11.738655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.739029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.739286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.758256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:11.759439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.816694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1157/2334] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:11.826225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:11.828240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:11.884689 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338d5f3-4d47-4637-bf15-0d5a39c8e03e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:11.888377 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:11.888979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:11.889508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:11.889779 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:11.899005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:11.900375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ae417-cd7b-4d30-8126-a5af2b48ab5d service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:11.909671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1178/2335] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:12.413355 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.420612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:12.453891 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b2d6f-a248-49ae-937f-288abe18d553 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.459375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.460018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.460290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.460565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] PATH_INFO: `/v3/projects/1434b6f9158349c29e513bc58203c0fa` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.461669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1434b6f9158349c29e513bc58203c0fa)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.463583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.518106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1434b6f9158349c29e513bc58203c0fa', 'request_id': 'req-84ed17a0-b006-46a9-9fa0-fd5f62775760'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.524405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1434b6f9158349c29e513bc58203c0fa', 'request_id': 'req-84ed17a0-b006-46a9-9fa0-fd5f62775760'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.531795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1434b6f9158349c29e513bc58203c0fa', 'request_id': 'req-84ed17a0-b006-46a9-9fa0-fd5f62775760'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.542859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] The token cache is being invalidate because project 1434b6f9158349c29e513bc58203c0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:12.543189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.543848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-84ed17a0-b006-46a9-9fa0-fd5f62775760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:12.545346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1158/2336] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:12 2022] DELETE /identity/v3/projects/1434b6f9158349c29e513bc58203c0fa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:12.551030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.551554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.551554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.572799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:12.574047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:12.632035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1179/2337] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:12.640663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.640942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.641210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.660887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:12.662107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:12.670065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1159/2338] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:12.674461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.685054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513340-acb7-4c31-9ffe-59e00ebfcb82 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.690189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.690710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.690980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.691245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.691885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:12.692179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.693765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.705979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1180/2339] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:12.710476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.720283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361192-32fa-4c0e-8522-710d34190f7d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.724876 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.725472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.725746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.726049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.726665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.728539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.754587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1160/2340] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:12 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:12.758828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.769300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f575-311d-419a-b3fe-d0a8b81e2f08 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.795127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:12.835982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.836596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.836871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.837137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.837766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.839727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.861510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1181/2341] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:12 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:12.865684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.875874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790255-0b81-4ad8-ac7b-e55780a72dbb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.883966 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.884625 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.884907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.885201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.885845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.887598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.902515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1161/2342] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:12.907336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.917418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030573f-d9ba-4fd5-8975-eac942c02b0c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.922354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.923044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.923319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.923895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.924539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.926160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615ae1b-d68a-4266-aa4b-8ed94a14a785 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.936313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1182/2343] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:12.940286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:12.951165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cefba-837d-4f01-ad00-5d637cd1567f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:12.956477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:12.957154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:12.957423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:12.957691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] PATH_INFO: `/v3/projects/36f1620488774d0798320943e5d700e9/users/cf725f44d29d482dbead307f8d0c19d7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:12.974279 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f1620488774d0798320943e5d700e9, user_id=cf725f44d29d482dbead307f8d0c19d7, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:12.976930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:12.990439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1162/2344] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:12 2022] PUT /identity/v3/projects/36f1620488774d0798320943e5d700e9/users/cf725f44d29d482dbead307f8d0c19d7/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:13.001443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.001724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.002037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.031825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] MFA Rules not processed for user `cf725f44d29d482dbead307f8d0c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:13.033233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.098138 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1183/2345] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:13.109558 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.111257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.123286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.300098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd54aee-1cc3-48ef-8b6e-35a3a0a453c8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.304882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.305487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.305757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.306073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.317284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.318752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677bbcd-43b0-4f5b-a5a6-a2824fb55fef service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.327920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1163/2346] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:13.353060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.417207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8701a-cd46-4492-ad91-1eddcc33a989 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.422317 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.422939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.423215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.423484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] PATH_INFO: `/v3/users/cf725f44d29d482dbead307f8d0c19d7` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.424590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf725f44d29d482dbead307f8d0c19d7)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.426592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.469401 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:13.476973 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf725f44d29d482dbead307f8d0c19d7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.485503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf725f44d29d482dbead307f8d0c19d7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.498298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf725f44d29d482dbead307f8d0c19d7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.506055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf725f44d29d482dbead307f8d0c19d7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.506990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf725f44d29d482dbead307f8d0c19d7'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:13.513787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1184/2347] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:13 2022] DELETE /identity/v3/users/cf725f44d29d482dbead307f8d0c19d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:13.519079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.519551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.519635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.539642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:13.541042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.615258 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1164/2348] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:13.625597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:13.627201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:13.699560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4c3e8-9b42-4e58-8e16-324be93e6c89 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:13.704095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:13.704734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:13.705012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:13.705345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:13.717920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:13.720800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a71e-7116-42b1-8451-d700ac411c04 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:13.737956 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1185/2349] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:14.161864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.163311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.178069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7f45-92df-4474-9446-8f0a19685923 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.183276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.183893 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.184166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.184421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] PATH_INFO: `/v3/projects/36f1620488774d0798320943e5d700e9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.185562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f1620488774d0798320943e5d700e9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.187608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.238835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f1620488774d0798320943e5d700e9', 'request_id': 'req-05183eaf-abcd-4053-a75a-1655ee4e18eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:14.245875 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f1620488774d0798320943e5d700e9', 'request_id': 'req-05183eaf-abcd-4053-a75a-1655ee4e18eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:14.254053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f1620488774d0798320943e5d700e9', 'request_id': 'req-05183eaf-abcd-4053-a75a-1655ee4e18eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:14.264816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] The token cache is being invalidate because project 36f1620488774d0798320943e5d700e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:14.265633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:14.266271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-05183eaf-abcd-4053-a75a-1655ee4e18eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:14.267765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1165/2350] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:14 2022] DELETE /identity/v3/projects/36f1620488774d0798320943e5d700e9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:14.272594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.272872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.273163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.293158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:14.294490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.354620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1186/2351] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:14.421427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.421711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.422019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.441826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:14.443069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.451009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1166/2352] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:14.455828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.466475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f20809-d1a4-4217-873d-0ece4de3308d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.472038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.472639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.472910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.473173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.473841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:14.474166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.475807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.488361 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1187/2353] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:14.492780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.503082 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4329a7-403c-4851-9660-4830eacce929 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.507933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.508532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.508800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.509059 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.509707 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.511664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.539442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1167/2354] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:14.543617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.555114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38913c3-97b1-4aac-b643-56fd68dbd808 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.603580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:14.622404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.623010 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.623281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.623545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.624177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.626357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.649287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1188/2355] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:29:14.654545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.663900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43565-7de6-43b5-9575-de28cf20b78d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.668444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.669035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.669413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.669888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.670584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.673164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.674913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:14.688524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1168/2356] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:14.690017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.700059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d1d1b-cbaa-4fc2-a4a5-87013529aa68 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.704935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.705566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.705891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.706277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.706772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.709553 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeee795-70f7-47e8-9822-eea27ef99833 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.721389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1189/2357] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:14.725568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.736294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7f7b-780e-436d-8972-a3ed73f2ae0b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.741030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.741690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.742002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.742271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] PATH_INFO: `/v3/projects/e0985059bb2e42d0aa77f140092bf4cd/users/e61946c56c3f47d491774d5e392ae2e0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.759788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0985059bb2e42d0aa77f140092bf4cd, user_id=e61946c56c3f47d491774d5e392ae2e0, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.762444 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.775172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1169/2358] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:14 2022] PUT /identity/v3/projects/e0985059bb2e42d0aa77f140092bf4cd/users/e61946c56c3f47d491774d5e392ae2e0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:14.785642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.785953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.786229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.813622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] MFA Rules not processed for user `e61946c56c3f47d491774d5e392ae2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:14.814839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.877470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1190/2359] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:14.888962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:14.891860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:14.945627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c37950-5166-4e58-8906-84388970c644 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:14.949211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:14.949799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:14.950099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:14.950364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:14.959268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:14.960658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:14.969752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1170/2360] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:23.433446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:23.435013 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.496749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ad0cd-1aeb-4004-b8ac-bcb9c30d65db None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:23.500106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:23.500732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:23.501041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:23.501308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:23.503418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:23.579393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:23.580822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf718f-3f0e-4863-b012-f62d6e194b8e service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:23.590477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1191/2361] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:24.174656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:24.185553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba209-e6f9-48d5-8867-049b9249fade service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:24.190655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:24.191278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:24.191551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:24.191816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] PATH_INFO: `/v3/users/e61946c56c3f47d491774d5e392ae2e0` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:24.192915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61946c56c3f47d491774d5e392ae2e0)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:24.194842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:24.242896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61946c56c3f47d491774d5e392ae2e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:24.250874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61946c56c3f47d491774d5e392ae2e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:24.263949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61946c56c3f47d491774d5e392ae2e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:24.264892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61946c56c3f47d491774d5e392ae2e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:24.265492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61946c56c3f47d491774d5e392ae2e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:24.277576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1171/2362] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:24 2022] DELETE /identity/v3/users/e61946c56c3f47d491774d5e392ae2e0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:24.282649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:24.282930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:24.283375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:24.295426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:24.307288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:24.308479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:24.368176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1192/2363] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:24.379078 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:24.380517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:24.437837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:24.444711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ff38-4610-4c35-bc33-4e5dd9108e9b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:24.450608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:24.451387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:24.451842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:24.452118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:24.463140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:24.465147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430a343-487e-4547-82a4-cda61c777f41 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:24.478936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1172/2364] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:24.960267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:24.961924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:25.004398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849f738-af8e-4604-b4a4-c275c4bc8b95 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.013781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.014712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.015097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.015206 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] PATH_INFO: `/v3/projects/e0985059bb2e42d0aa77f140092bf4cd` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.021931 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0985059bb2e42d0aa77f140092bf4cd)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.023882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.077626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0985059bb2e42d0aa77f140092bf4cd', 'request_id': 'req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:25.087666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0985059bb2e42d0aa77f140092bf4cd', 'request_id': 'req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:25.107069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0985059bb2e42d0aa77f140092bf4cd', 'request_id': 'req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:25.122647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] The token cache is being invalidate because project e0985059bb2e42d0aa77f140092bf4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:25.122944 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:25.123606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4978e6b2-b0b7-4a1f-8fa2-afadc56065f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:25.129253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1193/2365] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:24 2022] DELETE /identity/v3/projects/e0985059bb2e42d0aa77f140092bf4cd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:25.131532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.131959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.132427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.212195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:25.214535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:25.353311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1173/2366] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:25.361065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.361379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.361653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.391763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:25.392598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:25.418182 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1194/2367] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:25.424095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.434321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07182c28-c62f-4062-98d4-d9b47f0b5089 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.440759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.441645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.442201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.442776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.443628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:29:25.444143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.446136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.464884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1174/2368] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:29:25.471797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.484148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc3a59-dccd-43f6-9baa-754e330e93d6 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.493749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.497729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.498107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.498818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.499143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.503521 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.549404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1195/2369] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:25 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:25.553769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.564600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7dc7-2901-476c-9697-9df6b0f106c7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.648482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.649096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.649369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.649639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.650304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.652680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.700327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1175/2370] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:25 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:25.702500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.713831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ea3a5-a212-4f4d-96b6-7e56ded4c113 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.719373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.720381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.720646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.720961 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.721652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.723446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.738802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1196/2371] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:25.740006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.751906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7818cb5-6e33-46a7-b242-49f3b7247f3a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.758393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.759649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.760461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.761046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.762220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.764451 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dfe39-4cf7-41c7-98ae-288a61f28681 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.779005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1176/2372] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:29:25.784308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.798222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6791a2-7f10-427d-adc0-df1d4ae71f6e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:25.803248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:25.803920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.804195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.804464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] PATH_INFO: `/v3/projects/3e159369b59f4cd9998ac7b8972ab27c/users/1a11ea610c8e4d21ace192cba7411516/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.822353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e159369b59f4cd9998ac7b8972ab27c, user_id=1a11ea610c8e4d21ace192cba7411516, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:25.830696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:25.845644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1197/2373] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:25 2022] PUT /identity/v3/projects/3e159369b59f4cd9998ac7b8972ab27c/users/1a11ea610c8e4d21ace192cba7411516/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:25.850986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ceb8b-47b4-4116-8a1a-3cde7a62eb7d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:25.851264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ceb8b-47b4-4116-8a1a-3cde7a62eb7d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:25.851528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ceb8b-47b4-4116-8a1a-3cde7a62eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:25.876032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-360ceb8b-47b4-4116-8a1a-3cde7a62eb7d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:25.878342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-360ceb8b-47b4-4116-8a1a-3cde7a62eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:25.933553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:25.948218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1177/2374] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:25.958349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:25.960046 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:25.987892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:26.019776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30780-2a88-44b1-bb8e-5366ea0964f9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:26.023422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:26.024025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:26.024300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:26.024564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:26.034109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:26.035536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:26.045213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1198/2375] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:32.090760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.091255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.091364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.127315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] MFA Rules not processed for user `1a11ea610c8e4d21ace192cba7411516`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:32.128678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:32.238021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1178/2376] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:32.239381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.251642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31e2b-e7e2-4366-96f5-8222ca26fc4f service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.257084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.257852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.258270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.258646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.259545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.261629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.303495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1199/2377] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:29:32 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:32.307638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.331117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1c89-f201-434d-bce1-5a95efc60ab7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.395321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.396022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.396294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.396556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.397187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.399160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.423899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1179/2378] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:29:32 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:29:32.427987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.439660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab56f3-0aa0-4c8e-a762-9e37e37e4763 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.444788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.445430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.445704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.446003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.446645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.448400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.460109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1200/2379] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:32.464458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.475774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6226-5433-429a-81f8-5ea7ebe117d5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.480902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.481721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.482014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.482289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] PATH_INFO: `/v3/projects/919018af25904857b88089bebee37568/users/79e5f151b4ee4c0290a54f1c04977d3d/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.499325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919018af25904857b88089bebee37568, user_id=79e5f151b4ee4c0290a54f1c04977d3d, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.502690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.526993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1180/2380] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:32 2022] PUT /identity/v3/projects/919018af25904857b88089bebee37568/users/79e5f151b4ee4c0290a54f1c04977d3d/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:32.531289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.542965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8842-734a-4490-bc17-3ef084e75c44 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.619436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.620705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.620705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.620905 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.621424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.629162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.648525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1201/2381] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:29:32.649471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:32.669846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c9c70-c541-4f68-8890-7ed378d5d494 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:32.679693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:32.680662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:32.681124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:32.681964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] PATH_INFO: `/v3/projects/919018af25904857b88089bebee37568/users/79e5f151b4ee4c0290a54f1c04977d3d/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:32.684737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919018af25904857b88089bebee37568, user_id=79e5f151b4ee4c0290a54f1c04977d3d, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:32.687832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:32.701010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1181/2382] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:29:32 2022] PUT /identity/v3/projects/919018af25904857b88089bebee37568/users/79e5f151b4ee4c0290a54f1c04977d3d/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.087190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.089656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.110496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cde5d-8411-4f26-821b-69a472e67ef5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.187530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.188310 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.188586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.189368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] PATH_INFO: `/v3/users/6ffd6f0d01364b5c9d9be5072e38fe0c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.190077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffd6f0d01364b5c9d9be5072e38fe0c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.192572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.241364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.269785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffd6f0d01364b5c9d9be5072e38fe0c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.280035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffd6f0d01364b5c9d9be5072e38fe0c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.297382 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffd6f0d01364b5c9d9be5072e38fe0c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.305674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffd6f0d01364b5c9d9be5072e38fe0c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.306690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffd6f0d01364b5c9d9be5072e38fe0c'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.315219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1202/2383] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/users/6ffd6f0d01364b5c9d9be5072e38fe0c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.547024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.548865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:34.572352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ea1eb-3256-44cc-a72f-18a6d9de5045 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.645165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:34.680480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.681127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.681544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.681816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] PATH_INFO: `/v3/projects/626bd922b6fc4105b1f8acf49b691f53` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.683453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626bd922b6fc4105b1f8acf49b691f53)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.686678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:34.801581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626bd922b6fc4105b1f8acf49b691f53', 'request_id': 'req-b2088477-c72d-4dda-a143-5ba6e739e3d4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.814426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626bd922b6fc4105b1f8acf49b691f53', 'request_id': 'req-b2088477-c72d-4dda-a143-5ba6e739e3d4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.829520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626bd922b6fc4105b1f8acf49b691f53', 'request_id': 'req-b2088477-c72d-4dda-a143-5ba6e739e3d4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.854342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] The token cache is being invalidate because project 626bd922b6fc4105b1f8acf49b691f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:34.854790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.855628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:34.862054 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1182/2384] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/projects/626bd922b6fc4105b1f8acf49b691f53 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:34.863266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:34.899610 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a4413-659c-4081-8213-9a2851839594 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:34.989975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:34.990875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:34.991831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:34.992257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] PATH_INFO: `/v3/users/6db2643f138f4856bc5989df81e39882` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:34.993649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db2643f138f4856bc5989df81e39882)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:34.995890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.059819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db2643f138f4856bc5989df81e39882'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:35.070498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db2643f138f4856bc5989df81e39882'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:35.094952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db2643f138f4856bc5989df81e39882'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:35.106726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db2643f138f4856bc5989df81e39882'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:35.107520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-4eb0566d-989f-4619-8feb-3a9951cd31c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db2643f138f4856bc5989df81e39882'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:35.120631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1203/2385] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:29:34 2022] DELETE /identity/v3/users/6db2643f138f4856bc5989df81e39882 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:29:35.798999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:35.800702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:35.823746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088477-c72d-4dda-a143-5ba6e739e3d4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:35.923307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:35.924253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:35.924904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:35.924904 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] PATH_INFO: `/v3/projects/a0e459d484634d6ba6afd54be71ac66e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:35.926361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e459d484634d6ba6afd54be71ac66e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:35.928340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:35.993847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e459d484634d6ba6afd54be71ac66e', 'request_id': 'req-4bac24f7-e432-48a9-b575-b06f6e73555f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:36.003714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e459d484634d6ba6afd54be71ac66e', 'request_id': 'req-4bac24f7-e432-48a9-b575-b06f6e73555f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:36.018489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e459d484634d6ba6afd54be71ac66e', 'request_id': 'req-4bac24f7-e432-48a9-b575-b06f6e73555f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:36.037352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:36.045120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] The token cache is being invalidate because project a0e459d484634d6ba6afd54be71ac66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:29:36.045933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:36.048378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4bac24f7-e432-48a9-b575-b06f6e73555f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:29:36.061768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1183/2386] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:29:35 2022] DELETE /identity/v3/projects/a0e459d484634d6ba6afd54be71ac66e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:29:37.130596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:37.131146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:37.131146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:37.153756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] MFA Rules not processed for user `7bd39d1cce924d77979ded850bbfbea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:37.154941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:37.186285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:37.250598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1204/2387] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:39.482150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cbed-0610-4afb-a7c7-42f4e19fc349 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:39.482706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cbed-0610-4afb-a7c7-42f4e19fc349 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:39.482706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918cbed-0610-4afb-a7c7-42f4e19fc349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:39.536657 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a918cbed-0610-4afb-a7c7-42f4e19fc349 None None] MFA Rules not processed for user `79e5f151b4ee4c0290a54f1c04977d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:39.538213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a918cbed-0610-4afb-a7c7-42f4e19fc349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:39.654720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1184/2388] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:39.667073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:39.669210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:39.760826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fd735-b738-44a0-babe-316f253ba391 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:39.765365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:39.766135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:39.766409 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:39.766824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:39.769187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:39.871485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:39.873495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:39.898368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1205/2389] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:40.056571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-436d-4a52-a1be-73358364e93c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.056930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-436d-4a52-a1be-73358364e93c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.057288 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c493-436d-4a52-a1be-73358364e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.089434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0bb4c493-436d-4a52-a1be-73358364e93c None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:40.090686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0bb4c493-436d-4a52-a1be-73358364e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:40.159151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1185/2390] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:40.215880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:40.218517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:40.300002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c25d3-cfb8-4c0e-9854-c26ca0b64455 service glance] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:40.311860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:40.312678 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:40.313050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:40.313450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:40.323619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:40.325537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:40.335858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1206/2391] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:29:47.022458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:47.022953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:47.023065 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:47.046015 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:47.047227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:47.056473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1186/2392] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:47.079832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:47.105460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a1e7b-8ba8-4e57-8548-f37a460b0c22 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:47.117835 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:47.118595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:47.118829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:47.119106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:47.136130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:47.138580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a030a-885a-4be4-b84f-56974a20a444 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:47.151650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1207/2393] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:29:50.884584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:50.886740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:50.959498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7d0e-6e49-4fe9-a434-a0e83f8b82d0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:50.963168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:50.963781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:50.964060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:50.964333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:50.966157 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:50.991387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:51.041127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:51.042176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:51.042653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:51.053280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:29:51.073410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] MFA Rules not processed for user `1a11ea610c8e4d21ace192cba7411516`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:51.075067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:51.083628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:51.088881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8edefe-8215-4643-be80-545c8c25292e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:51.089473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1208/2394] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:29:51.126566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:51.128552 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:51.141158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1187/2395] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:29:51.143836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eee485-22e3-4a28-8e86-56dc84b9e752 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:51.147706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:51.148528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:51.148903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:51.149267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:51.151274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:51.178477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:51.182538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:51.196450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1209/2396] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:29:53.729119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482051a-2417-430a-9b59-6d5970779171 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.729633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482051a-2417-430a-9b59-6d5970779171 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.729748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482051a-2417-430a-9b59-6d5970779171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.768200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6482051a-2417-430a-9b59-6d5970779171 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:29:53.769499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6482051a-2417-430a-9b59-6d5970779171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:29:53.785238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1188/2397] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:29:53.799133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:29:53.815699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e87e-3714-49f1-8001-83487501a4db service glance] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:29:53.830730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:29:53.831342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:29:53.831616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:29:53.831880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:29:53.846997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:29:53.848807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171cd8a-db31-448f-8476-9f3638fa0896 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:29:53.867503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1210/2398] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:30:03.751319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=36 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:03.860038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=13 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:04.970567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482051a-2417-430a-9b59-6d5970779171 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:04.972026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6482051a-2417-430a-9b59-6d5970779171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:04.987225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482051a-2417-430a-9b59-6d5970779171 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:04.992623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:04.993210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:04.993484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:04.993750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:04.995406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:05.073204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:05.074809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954e161-aeb0-45c9-8816-1c4bde93b2fc service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:05.093685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1189/2399] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:14.799861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc78e-6c01-46be-ab78-d839ac45a066 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.800393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc78e-6c01-46be-ab78-d839ac45a066 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.800393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afc78e-6c01-46be-ab78-d839ac45a066 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.801810 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1211/2400] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:30:14.807386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787aaf-a2b9-447d-b480-5b0bf589d813 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.807822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787aaf-a2b9-447d-b480-5b0bf589d813 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.808058 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787aaf-a2b9-447d-b480-5b0bf589d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.848436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c3787aaf-a2b9-447d-b480-5b0bf589d813 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:14.849629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c3787aaf-a2b9-447d-b480-5b0bf589d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:14.859029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1190/2401] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:14.870172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afc78e-6c01-46be-ab78-d839ac45a066 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:14.882927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afc78e-6c01-46be-ab78-d839ac45a066 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:14.886524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06607bda2bed4773af2dce7a16b5c141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:14.887158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.887432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.887699 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.899048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:14.900470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92b058-5d36-4516-9aee-7514617092ed service glance] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:14.911464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1212/2402] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:14.980057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29116-99e8-4262-bf56-2e997e0ccf41 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.980333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29116-99e8-4262-bf56-2e997e0ccf41 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.980594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29116-99e8-4262-bf56-2e997e0ccf41 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:14.981959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1191/2403] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:30:14.986602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf26d1-5892-41dc-b526-b3a1270f25f1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:14.986885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf26d1-5892-41dc-b526-b3a1270f25f1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:14.987154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf26d1-5892-41dc-b526-b3a1270f25f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.025233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-79bf26d1-5892-41dc-b526-b3a1270f25f1 None None] MFA Rules not processed for user `21b6715254e34797a3af9b291d26b1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:15.026462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-79bf26d1-5892-41dc-b526-b3a1270f25f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.032796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1213/2404] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:30:15.044390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c29116-99e8-4262-bf56-2e997e0ccf41 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.055304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c29116-99e8-4262-bf56-2e997e0ccf41 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.058841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.059421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.059692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.059958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.067343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.068740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e82544-caec-42ba-83fa-7d16f1b1497b service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.076268 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1192/2405] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:15.158924 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f66ef0-b0bb-4ded-a586-33865b4fbb05 None None] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.159207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f66ef0-b0bb-4ded-a586-33865b4fbb05 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.159477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f66ef0-b0bb-4ded-a586-33865b4fbb05 None None] PATH_INFO: `/` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.160821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1214/2406] 10.222.0.30 () {54 vars in 921 bytes} [Sun Aug 7 18:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 18:30:15.166223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668b267-4ea7-4358-a1c5-0c1d1da42190 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.166503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668b267-4ea7-4358-a1c5-0c1d1da42190 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.166769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668b267-4ea7-4358-a1c5-0c1d1da42190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.186206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5668b267-4ea7-4358-a1c5-0c1d1da42190 None None] MFA Rules not processed for user `c221970fdea24fa5997ab29aa35c2f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:15.187376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5668b267-4ea7-4358-a1c5-0c1d1da42190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:15.196918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1193/2407] 10.222.0.30 () {58 vars in 1018 bytes} [Sun Aug 7 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:15.207833 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f66ef0-b0bb-4ded-a586-33865b4fbb05 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:15.218756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f66ef0-b0bb-4ded-a586-33865b4fbb05 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:15.222580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:15.223163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:15.223439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:15.223706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:15.233819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:15.235260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:15.246545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1215/2408] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:17.155799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6db9b-691c-4459-862c-312226e723bd None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:17.156276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6db9b-691c-4459-862c-312226e723bd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:17.156378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6db9b-691c-4459-862c-312226e723bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:17.206907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-41d6db9b-691c-4459-862c-312226e723bd None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:17.208121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-41d6db9b-691c-4459-862c-312226e723bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:17.227035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1194/2409] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:17.241354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:17.263254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827f091-9a1f-4819-bf0d-57ac76166662 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:17.268592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:17.269186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:17.269457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:17.269722 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:17.278094 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:17.279702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b96ed9-7af9-4f20-9e6a-4e1c76170340 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:17.288300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1216/2410] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:30:27.222408 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=77 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:27.285021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=31 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:32.706403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6db9b-691c-4459-862c-312226e723bd None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:32.708026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-41d6db9b-691c-4459-862c-312226e723bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:32.719353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6db9b-691c-4459-862c-312226e723bd None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:32.722841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:32.723427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:32.723723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:32.723985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:32.725601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:32.734539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:32.735920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:32.744060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1195/2411] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:41.197295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563e54-35ca-4772-af15-02f0dc3b76c8 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.197733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563e54-35ca-4772-af15-02f0dc3b76c8 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.197733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563e54-35ca-4772-af15-02f0dc3b76c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.217775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-98563e54-35ca-4772-af15-02f0dc3b76c8 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:41.219350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-98563e54-35ca-4772-af15-02f0dc3b76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:41.228852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1217/2412] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:41.260063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:41.274119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1e782-2623-489a-abf3-c7dec8325248 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:41.279808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:41.280414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:41.280684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:41.280951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:41.291527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:41.293271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:41.305237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1196/2413] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:30:43.399291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:43.399735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:43.399839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:43.418064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] MFA Rules not processed for user `14a26414025b4560b13fb9d741a2d7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:30:43.419257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:43.472509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1218/2414] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:30:44.218153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:44.219628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:44.296271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c7e2f-ec56-4457-bf61-223c852be059 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:44.303111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:44.303921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:44.304191 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:44.304452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:44.306492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:30:44.318476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:44.320031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:44.330104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1197/2415] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:47.827110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:30:47.836762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c839-55aa-4833-a302-a9c6c89dd1d1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:30:47.840331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:30:47.840928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:30:47.841204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:30:47.841471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:30:47.850922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:30:47.852381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:30:47.861777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1219/2416] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:30:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:30:54.326076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=44 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:30:57.857661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=34 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:22.929137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:22.938767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e045ac-1eb9-4a33-b9a6-0cfe5c9026eb service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:22.943744 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:22.944824 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:22.945096 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:22.945359 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:22.947124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:23.009726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:23.011197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:23.021574 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1198/2417] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:26.282318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:26.283780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:26.299119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8e6-d5fa-4853-883f-b2d286048e84 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:26.304529 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:26.305157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.305431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.305692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] PATH_INFO: `/v3/users/5ce6653be14c4cd1b25ef3fe20739c12` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.306837 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce6653be14c4cd1b25ef3fe20739c12)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:26.308847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:26.357338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce6653be14c4cd1b25ef3fe20739c12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.364967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce6653be14c4cd1b25ef3fe20739c12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.377054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce6653be14c4cd1b25ef3fe20739c12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.384284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce6653be14c4cd1b25ef3fe20739c12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.384912 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-7a35eed2-ad30-4931-ae99-7dafe61f6809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce6653be14c4cd1b25ef3fe20739c12'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.390630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1220/2418] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:26 2022] DELETE /identity/v3/users/5ce6653be14c4cd1b25ef3fe20739c12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:26.560400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:26.570973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4974b0-ca68-4cd4-aaf2-e83f51a86650 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:26.629701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:26.630283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.630555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.630821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] PATH_INFO: `/v3/projects/89cd2880bd764ebdb6ae9acdbead040d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.631944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cd2880bd764ebdb6ae9acdbead040d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:26.634586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:26.681403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cd2880bd764ebdb6ae9acdbead040d', 'request_id': 'req-213af285-ccc8-455a-8fc0-dbdcb94a6675'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.687974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cd2880bd764ebdb6ae9acdbead040d', 'request_id': 'req-213af285-ccc8-455a-8fc0-dbdcb94a6675'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.695109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cd2880bd764ebdb6ae9acdbead040d', 'request_id': 'req-213af285-ccc8-455a-8fc0-dbdcb94a6675'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.706577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] The token cache is being invalidate because project 89cd2880bd764ebdb6ae9acdbead040d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:26.706861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.707473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-213af285-ccc8-455a-8fc0-dbdcb94a6675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:26.708910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1199/2419] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:26 2022] DELETE /identity/v3/projects/89cd2880bd764ebdb6ae9acdbead040d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:26.713847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.714160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.714429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.734631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:26.735840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:26.794841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1221/2420] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:26.802751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.803033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.803300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.823691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:26.824850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:26.832514 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1200/2421] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:26.836566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:26.846038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ef946-5749-4e6e-bba5-29e2acab76c1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:26.850564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:26.851695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.851965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.852228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.852863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:26.853181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:26.854830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:26.866021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1222/2422] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:26.870632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:26.879538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f50c4-62ad-4916-b66b-f5533d4f6743 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:26.884244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:26.884775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.885044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.885303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.885954 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:26.888049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:26.904929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:26.927362 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1201/2423] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:26 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:26.932268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:26.942391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da72070-9e15-4c44-b9b0-4a99c2d0e038 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:26.997535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:26.998152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:26.998427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:26.998695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:26.999306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:27.001209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:27.008848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:27.023487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1223/2424] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:26 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:27.027551 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:27.037955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2a7f-4f6a-404d-852c-76b7ba59ec72 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:27.043150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:27.043735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:27.044009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:27.044272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:27.044895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:27.046533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:27.056714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1202/2425] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:27.060414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:27.070208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1bcc4-81b8-490a-9b90-c5e4bc12e8e1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:27.074742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:27.075323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:27.075595 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:27.075860 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:27.076485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:27.078088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69eb42-203b-4cab-814d-9c4c92f2c59e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:27.088804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1224/2426] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:27.092913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:27.103328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568ad8f-9e23-4c7c-adf6-816628a89028 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:27.107997 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:27.108639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:27.108914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:27.109181 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] PATH_INFO: `/v3/projects/4c8e03dac09849b690be506918ef7727/users/1a546dba7fe84428a7a8ec9d3225d039/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:27.123470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e03dac09849b690be506918ef7727, user_id=1a546dba7fe84428a7a8ec9d3225d039, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:27.126105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:27.139823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1203/2427] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:27 2022] PUT /identity/v3/projects/4c8e03dac09849b690be506918ef7727/users/1a546dba7fe84428a7a8ec9d3225d039/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:27.150562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:27.150844 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:27.151117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:27.178128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] MFA Rules not processed for user `1a546dba7fe84428a7a8ec9d3225d039`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:27.179364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:27.259195 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1225/2428] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:27.276925 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:27.278828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:27.358349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b682d-2b02-4037-b40c-93fb5caaaf47 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:27.363963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:27.364704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:27.364976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:27.365241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:27.372817 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:27.374456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11323c8c-5ddb-496c-a9e5-016da5b97ee9 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:27.382956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1204/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:30.054422 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.112287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f646944-1492-4c16-9f0c-488ce929d70e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.117561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.118214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.118486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.118749 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] PATH_INFO: `/v3/users/1a546dba7fe84428a7a8ec9d3225d039` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.119852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a546dba7fe84428a7a8ec9d3225d039)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.121783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.170459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a546dba7fe84428a7a8ec9d3225d039'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.177675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a546dba7fe84428a7a8ec9d3225d039'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.188513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:30.189815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a546dba7fe84428a7a8ec9d3225d039'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.198537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a546dba7fe84428a7a8ec9d3225d039'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.199166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a546dba7fe84428a7a8ec9d3225d039'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.204891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1226/2430] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:30 2022] DELETE /identity/v3/users/1a546dba7fe84428a7a8ec9d3225d039 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:30.209424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.209931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.210045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.230623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:30.231819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.289232 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1205/2431] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:30.299806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.301208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.356763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6917-f795-45ca-9a19-44d5e2ea30ee admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.360369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.360962 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.361234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.361495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.370309 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.371729 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645ca7e-5bc5-485d-a929-0ee7a62a2123 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.381061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1227/2432] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:30.649309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.651494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.664920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe05b67-42b7-416e-8175-095938ba65c9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.669488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.670784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.671064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.671327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] PATH_INFO: `/v3/projects/4c8e03dac09849b690be506918ef7727` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.672424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e03dac09849b690be506918ef7727)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.674360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.711472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:30.726782 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e03dac09849b690be506918ef7727', 'request_id': 'req-99164b45-0c11-4603-8b6a-dedcd10a760a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.732810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e03dac09849b690be506918ef7727', 'request_id': 'req-99164b45-0c11-4603-8b6a-dedcd10a760a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.739894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e03dac09849b690be506918ef7727', 'request_id': 'req-99164b45-0c11-4603-8b6a-dedcd10a760a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.750793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] The token cache is being invalidate because project 4c8e03dac09849b690be506918ef7727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:30.751077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.751693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99164b45-0c11-4603-8b6a-dedcd10a760a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:30.753149 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1206/2433] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:30 2022] DELETE /identity/v3/projects/4c8e03dac09849b690be506918ef7727 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:30.758111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.758392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.758657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.778155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:30.779333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.841305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1228/2434] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:30.850449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.850731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.851001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.870550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:30.871719 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:30.879430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1207/2435] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:30.883692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.894778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3bad7-ad04-45b6-b7ac-74cfc32275b6 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.899370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.899965 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.900264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.900535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.901204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:30.901503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.903140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.914417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1229/2436] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:30.918745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.927752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8e301-f9fe-48a6-a3b7-fd72d2c4184c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:30.932860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:30.933449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:30.933727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:30.934026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:30.934654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:30.936529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:30.964247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1208/2437] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:30 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:30.968504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:30.979736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914531c1-f2ea-416b-9d02-dab0993e00b6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.036383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.036984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.037260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.037528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.038188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.040104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.060840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1230/2438] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:30 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:31.064950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.075845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464e98-d24d-458a-909f-fe3e9d1d8f0f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.080261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.080840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.081111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.081484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.082171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.084607 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.094611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1209/2439] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:31.098522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.109015 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054928-210b-4c65-bdc4-de497a11271f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.114196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.114795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.115068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.115330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.116080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.117758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa8151-8d93-4b1a-af76-552de96814d9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.119895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:31.131229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1231/2440] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:31.135488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.148804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515620-7cc2-4787-945d-8b367cd42e51 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.154673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.155742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.156241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.156613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] PATH_INFO: `/v3/projects/91ddad3d971c45dea8fbdf3d0bb27f95/users/4210325fd0874ef4b5cb093aad340376/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.172505 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ddad3d971c45dea8fbdf3d0bb27f95, user_id=4210325fd0874ef4b5cb093aad340376, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.175175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.188571 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1210/2441] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:31 2022] PUT /identity/v3/projects/91ddad3d971c45dea8fbdf3d0bb27f95/users/4210325fd0874ef4b5cb093aad340376/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:31.198975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.199241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.199535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.226252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] MFA Rules not processed for user `4210325fd0874ef4b5cb093aad340376`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:31.227481 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:31.290593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1232/2442] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:31.295651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.355717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275dad1-5186-48ab-a934-1272825818da admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.360264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.360851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.361123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.361388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.362029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.363918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.390284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1211/2443] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:31 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:31.394759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.405830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0fdf1-3eef-4f9d-9a98-50e160b2627e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.458650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.459247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.459520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.459786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.460383 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.462331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.484762 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1233/2444] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:31 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:31.488699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.499634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566173-fc45-4ed6-899d-154deed37488 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.504319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.504918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.505300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.505627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.506294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.510373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.522151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1212/2445] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:31.526584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.537188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99436c11-42aa-448d-b676-f1ee39c8cc6c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.541834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.542522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.542800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.543070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] PATH_INFO: `/v3/projects/808fe752fe68446f9704fb59d90a7325/users/986d9f9739864dcaae2e14d666eb294d/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.559636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808fe752fe68446f9704fb59d90a7325, user_id=986d9f9739864dcaae2e14d666eb294d, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.562692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.575816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1234/2446] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:31 2022] PUT /identity/v3/projects/808fe752fe68446f9704fb59d90a7325/users/986d9f9739864dcaae2e14d666eb294d/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:31.580025 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.590673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb7b5-b00c-427a-bda1-cdb6c5b1aeb5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.620976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:31.652245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.652899 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.653169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.653428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.654122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.655815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06bd5-84bb-4336-980b-266d7c0f2320 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.665358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1213/2447] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:31.670199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.680379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430e7e-7705-407e-8200-d6e544ad8493 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.685586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.686333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.686636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.686972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] PATH_INFO: `/v3/projects/808fe752fe68446f9704fb59d90a7325/users/986d9f9739864dcaae2e14d666eb294d/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.688969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] RBAC: Authorizing `identity:create_grant(project_id=808fe752fe68446f9704fb59d90a7325, user_id=986d9f9739864dcaae2e14d666eb294d, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.691677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.701814 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1235/2448] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:31 2022] PUT /identity/v3/projects/808fe752fe68446f9704fb59d90a7325/users/986d9f9739864dcaae2e14d666eb294d/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:31.713851 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.714159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.714423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.741421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] MFA Rules not processed for user `986d9f9739864dcaae2e14d666eb294d`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:31.742553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:31.808842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1214/2449] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:31.820102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:31.821831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:31.863775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:31.879631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df7e2-421f-4fed-81b5-d963a9ee34df admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:31.883334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:31.883939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:31.884216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:31.884487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:31.894440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:31.895864 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f8ef3-24f1-41a7-b4b4-1935d9e35c47 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:31.905823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1236/2450] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:32.321521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:32.388523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2c2e6-b049-4cc1-aff6-4b008c0aab54 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:32.394348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:32.394973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:32.395247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:32.395513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] PATH_INFO: `/v3/users/4210325fd0874ef4b5cb093aad340376` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:32.396629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4210325fd0874ef4b5cb093aad340376)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:32.398566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:32.455979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4210325fd0874ef4b5cb093aad340376'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:32.464641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4210325fd0874ef4b5cb093aad340376'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:32.465850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:32.480310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4210325fd0874ef4b5cb093aad340376'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:32.480971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4210325fd0874ef4b5cb093aad340376'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:32.482037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4210325fd0874ef4b5cb093aad340376'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:32.495581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1215/2451] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:32 2022] DELETE /identity/v3/users/4210325fd0874ef4b5cb093aad340376 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:32.500132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:32.500583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:32.500583 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:32.519688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:32.520876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:32.578524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1237/2452] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:32.588664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:32.590052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:32.646265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037bcc-586d-46f2-9075-38164f9d446f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:32.649930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:32.651195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:32.651471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:32.651737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:32.660609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:32.662048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:32.671433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1216/2453] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:32.943840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:32.945518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:32.957822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd9aed-1bb0-4296-902b-5f7d6fe79fd1 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:32.962597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:32.963857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:32.964125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:32.964388 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] PATH_INFO: `/v3/projects/91ddad3d971c45dea8fbdf3d0bb27f95` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:32.965495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ddad3d971c45dea8fbdf3d0bb27f95)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:32.967419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.017727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ddad3d971c45dea8fbdf3d0bb27f95', 'request_id': 'req-f2db4dce-7380-4e6f-8d18-4f74da95a054'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.024500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ddad3d971c45dea8fbdf3d0bb27f95', 'request_id': 'req-f2db4dce-7380-4e6f-8d18-4f74da95a054'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.030872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ddad3d971c45dea8fbdf3d0bb27f95', 'request_id': 'req-f2db4dce-7380-4e6f-8d18-4f74da95a054'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.040850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] The token cache is being invalidate because project 91ddad3d971c45dea8fbdf3d0bb27f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:33.041129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.041745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.043248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1238/2454] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:32 2022] DELETE /identity/v3/projects/91ddad3d971c45dea8fbdf3d0bb27f95 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:33.047167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.057402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b2b7-33f2-4373-9f6c-a03c258a1611 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.114282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.114909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.115182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.115449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] PATH_INFO: `/v3/users/986d9f9739864dcaae2e14d666eb294d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.116537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986d9f9739864dcaae2e14d666eb294d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.118525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.167293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986d9f9739864dcaae2e14d666eb294d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.176383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986d9f9739864dcaae2e14d666eb294d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.188936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986d9f9739864dcaae2e14d666eb294d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.189565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986d9f9739864dcaae2e14d666eb294d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.190186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e36e912-523c-4bb6-bdfd-967368ce7f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986d9f9739864dcaae2e14d666eb294d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.194767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:33.206321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1217/2455] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:33 2022] DELETE /identity/v3/users/986d9f9739864dcaae2e14d666eb294d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:33.488802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.490596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:33.504584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db4dce-7380-4e6f-8d18-4f74da95a054 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.566759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.567487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.567930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.568271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] PATH_INFO: `/v3/projects/808fe752fe68446f9704fb59d90a7325` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.569418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808fe752fe68446f9704fb59d90a7325)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.571385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.577694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:33.620302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808fe752fe68446f9704fb59d90a7325', 'request_id': 'req-2bcb3079-b8bb-4916-8d35-7b98a71cff63'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.628260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808fe752fe68446f9704fb59d90a7325', 'request_id': 'req-2bcb3079-b8bb-4916-8d35-7b98a71cff63'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.634730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808fe752fe68446f9704fb59d90a7325', 'request_id': 'req-2bcb3079-b8bb-4916-8d35-7b98a71cff63'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.645952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] The token cache is being invalidate because project 808fe752fe68446f9704fb59d90a7325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:33.646240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.646870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2bcb3079-b8bb-4916-8d35-7b98a71cff63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:33.648395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1239/2456] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:33 2022] DELETE /identity/v3/projects/808fe752fe68446f9704fb59d90a7325 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:33.653373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.653849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.654017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.673796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:33.675036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:33.739371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1218/2457] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:33.747661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.747943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.748211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.769044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:33.770272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:33.778430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1240/2458] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:33.782511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.791972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cadbf-0592-4425-9a46-42049bf92db7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.796698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.797296 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.797568 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.797830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.798498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:33.798792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.800365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.812961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1219/2459] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:33.817304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.832041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab316c-dad9-4d9c-be25-bccaf4224788 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.836790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.837391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.837665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.838418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.839068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.840994 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.873684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1241/2460] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:33 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:33.874830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.885793 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b348-7ba1-464d-bcdd-daaac830bac9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.941507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.942139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.942412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.942675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.943275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.945150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.965105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1220/2461] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:33 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:33.969239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:33.979405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c6417-3544-4426-a1a2-9a46139f6cd0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:33.984124 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:33.984711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:33.984985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:33.985251 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:33.985888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:33.987494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:33.998089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1242/2462] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:34.001770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.011920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58dbf6-0b23-4770-aeb3-838d149f3039 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.016448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.017277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.017549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.017812 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.018460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.020017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b34a-e6a2-4a5c-8268-8aff7bcab0b8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.029642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1221/2463] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:34.033478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.043275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0f47b-e79d-4def-af7b-5fd7086cffd4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.048118 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.048755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.049030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.049300 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] PATH_INFO: `/v3/projects/85d7a95f999d4e73bb82dc82d11c1f66/users/b9c146835f49464a96720dd8d803ea8d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.065109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d7a95f999d4e73bb82dc82d11c1f66, user_id=b9c146835f49464a96720dd8d803ea8d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.067725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.081312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1243/2464] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:34 2022] PUT /identity/v3/projects/85d7a95f999d4e73bb82dc82d11c1f66/users/b9c146835f49464a96720dd8d803ea8d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:34.091996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.092280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.092550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.121528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] MFA Rules not processed for user `b9c146835f49464a96720dd8d803ea8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:34.122740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:34.168513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:34.187062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1222/2465] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:34.191462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.252074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4530be6-803d-418d-b73e-48802fe667e5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.256765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.257357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.257635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.257918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.258559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.260450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.285782 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1244/2466] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:34 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:34.289867 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.300838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a7f39-f51d-42b3-8e31-378fd4196784 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.355237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.355877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.356128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.356371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.356980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.358929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.379636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1223/2467] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:34 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:34.383671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.394350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf27c3-0a0c-430f-aa1f-ddeda710a887 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.398978 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.399562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.399836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.400099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.400725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.402397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.412624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1245/2468] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:34.417285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.426862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db270e4a-bcda-46e3-b745-636ea236a526 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.431366 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.432579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.432888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.433178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] PATH_INFO: `/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4/users/9ad806df4110471e9d23167861794502/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.447654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc2ca8d48e4302893d4a7726b1f5e4, user_id=9ad806df4110471e9d23167861794502, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.450766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.463866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1224/2469] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:34 2022] PUT /identity/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4/users/9ad806df4110471e9d23167861794502/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:34.468081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.474342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:34.478939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa0eab-95d1-41a2-b766-0b160cb38058 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.544275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.544928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.545224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.545644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.546412 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.548192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428341-ca1b-4585-bf99-a509491f6735 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.559208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1246/2470] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:34.563655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.573835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a595ff-01bf-4eb7-9b95-56e98e801295 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.578445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.579083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.579357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.579626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] PATH_INFO: `/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4/users/9ad806df4110471e9d23167861794502/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.581516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc2ca8d48e4302893d4a7726b1f5e4, user_id=9ad806df4110471e9d23167861794502, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.584174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.594602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1225/2471] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:34 2022] PUT /identity/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4/users/9ad806df4110471e9d23167861794502/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:34.605992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.606243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.606519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.634133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] MFA Rules not processed for user `9ad806df4110471e9d23167861794502`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:34.635330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:34.702974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1247/2472] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:34.714742 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.716496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:34.774300 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9ac04-33a7-4e52-9294-742ee50da514 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.778251 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.778857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.779151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.779394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.788776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.790224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.800303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1226/2473] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:34.843463 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:34.844819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:34.857387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45e64d-2839-4eb4-b0fe-cad4b1a8570f None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:34.860897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:34.861484 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:34.861753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:34.862058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:34.926101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:34.927564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8c9d-b088-4efa-a76a-2a2e58408f3e service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:34.936811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1248/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:38.290861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:38.335357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:38.352351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905169-8e8d-4715-a707-cbbf50418485 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:38.356889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:38.357495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:38.357774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:38.358080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] PATH_INFO: `/v3/users/b9c146835f49464a96720dd8d803ea8d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:38.359230 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c146835f49464a96720dd8d803ea8d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:38.361127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:38.407119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c146835f49464a96720dd8d803ea8d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.414494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c146835f49464a96720dd8d803ea8d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.426309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c146835f49464a96720dd8d803ea8d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.426939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c146835f49464a96720dd8d803ea8d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.427533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c146835f49464a96720dd8d803ea8d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.439943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1227/2475] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:38 2022] DELETE /identity/v3/users/b9c146835f49464a96720dd8d803ea8d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:38.444543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:38.445005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:38.445189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:38.465665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:38.466879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:38.484798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:38.529853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1249/2476] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:38.539698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:38.541127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:38.599431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822590-51d5-46b0-87e9-102f88e58a87 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:38.603087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:38.604190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:38.604470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:38.604736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:38.613636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:38.615109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:38.625079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1228/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:38.887898 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:38.889685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:38.904416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654cc4-3c3c-43f5-a12d-10708e6d96f5 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:38.909128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:38.909768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:38.910079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:38.910349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] PATH_INFO: `/v3/projects/85d7a95f999d4e73bb82dc82d11c1f66` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:38.911472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d7a95f999d4e73bb82dc82d11c1f66)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:38.913380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:38.960714 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d7a95f999d4e73bb82dc82d11c1f66', 'request_id': 'req-afc61508-c45d-46b1-b553-631589d98790'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.967759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d7a95f999d4e73bb82dc82d11c1f66', 'request_id': 'req-afc61508-c45d-46b1-b553-631589d98790'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.973834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d7a95f999d4e73bb82dc82d11c1f66', 'request_id': 'req-afc61508-c45d-46b1-b553-631589d98790'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.984597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] The token cache is being invalidate because project 85d7a95f999d4e73bb82dc82d11c1f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:38.984878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.985490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:38.986990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1250/2478] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:38 2022] DELETE /identity/v3/projects/85d7a95f999d4e73bb82dc82d11c1f66 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:38.990982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.000293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461d324-ae61-43af-a8da-324b40f5274e service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.055077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.055688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.055960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.056223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] PATH_INFO: `/v3/users/9ad806df4110471e9d23167861794502` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.057316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad806df4110471e9d23167861794502)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.059243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:39.065217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:39.108647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad806df4110471e9d23167861794502'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.115955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad806df4110471e9d23167861794502'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.127953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad806df4110471e9d23167861794502'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.128606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad806df4110471e9d23167861794502'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.129234 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ec477894-4b58-499e-b4cf-23dc28b13992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad806df4110471e9d23167861794502'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.141308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1229/2479] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:38 2022] DELETE /identity/v3/users/9ad806df4110471e9d23167861794502 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:39.437457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.438952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:39.455038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61508-c45d-46b1-b553-631589d98790 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.510709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.511379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.511653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.511920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] PATH_INFO: `/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.513156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fc2ca8d48e4302893d4a7726b1f5e4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.515103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:39.560027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fc2ca8d48e4302893d4a7726b1f5e4', 'request_id': 'req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.561620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:39.567559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fc2ca8d48e4302893d4a7726b1f5e4', 'request_id': 'req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.574793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fc2ca8d48e4302893d4a7726b1f5e4', 'request_id': 'req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.585003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] The token cache is being invalidate because project c0fc2ca8d48e4302893d4a7726b1f5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:39.585323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.585981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-f7a02208-fbe7-4832-b2e5-0d9d2db3c807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:39.587447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1251/2480] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:39 2022] DELETE /identity/v3/projects/c0fc2ca8d48e4302893d4a7726b1f5e4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:39.592795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.593266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.593384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.612033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:39.613204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:39.674295 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1230/2481] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:39.683019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389125-c18c-4959-acaa-fa396348be3c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.683296 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389125-c18c-4959-acaa-fa396348be3c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.683562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24389125-c18c-4959-acaa-fa396348be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.705331 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-24389125-c18c-4959-acaa-fa396348be3c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:39.706549 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-24389125-c18c-4959-acaa-fa396348be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:39.715158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1252/2482] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:39.719845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.729338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4179-e000-4acf-b569-4ad930beedd7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.733828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.734458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.734733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.735000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.735635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:39.735929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.737500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:39.749174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1231/2483] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:39.753262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389125-c18c-4959-acaa-fa396348be3c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.762914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24389125-c18c-4959-acaa-fa396348be3c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.767771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.768355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.768662 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.768892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.769497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.771389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:39.796863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1253/2484] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:39.801126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.811323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cba9-7130-41d2-b943-045b359f105e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.865492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.866117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.866428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.866765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.867385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.869773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:39.894498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1232/2485] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:39 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:39.898639 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:39.908826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d1799-a110-47aa-855b-28160c2584ae admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:39.913400 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:39.914021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:39.914295 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:39.914560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:39.915191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:39.916764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.051638 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1254/2486] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:40.055805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.061503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:40.067913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264fa72-e934-47aa-b081-a216154623b7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.074460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.075030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.075298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.075561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.076185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.077759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43150f-e51e-4a79-8a64-6fd79dd7965d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.088210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1233/2487] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:40.092369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.102090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a891e8-e8a8-4201-8066-c2a22059c90c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.107308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.107954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.108230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.108497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] PATH_INFO: `/v3/projects/a8db8d74300c46c3908246c82b42148b/users/a2cb2078529a490ea8867b734705a387/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.127229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8db8d74300c46c3908246c82b42148b, user_id=a2cb2078529a490ea8867b734705a387, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.130698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.144732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1255/2488] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:40 2022] PUT /identity/v3/projects/a8db8d74300c46c3908246c82b42148b/users/a2cb2078529a490ea8867b734705a387/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:40.155105 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.155472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.155750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.184013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] MFA Rules not processed for user `a2cb2078529a490ea8867b734705a387`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:40.185209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:40.250732 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1234/2489] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:40.255477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.315340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b75bbe-5e44-46eb-bbc3-5a15d381e746 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.319880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.320466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.320747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.321012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.321608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.323531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.349349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1256/2490] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:40 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:40.353922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.365402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febadd06-732e-413c-81f2-d619e775e6fa None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.422074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.422764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.423034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.423298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.423919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.425810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.448120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1235/2491] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:40 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:40.454740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.463286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ed14-4d1f-4b76-8623-7a9ef47cff07 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.467903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.468494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.468765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.469030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.469654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.471255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.482220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1257/2492] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:40.488282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.497104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66883a5-96b1-4cd1-b0fe-0ce7a5ebc4e3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.502021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.502679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.502958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.503231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] PATH_INFO: `/v3/projects/2a731d8bfc8f46808198935be605a690/users/1291e01070534ca494d8298b76483066/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.518407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a731d8bfc8f46808198935be605a690, user_id=1291e01070534ca494d8298b76483066, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.523146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.537458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1236/2493] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:40 2022] PUT /identity/v3/projects/2a731d8bfc8f46808198935be605a690/users/1291e01070534ca494d8298b76483066/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:40.542092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.552444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e803e59-a158-4bae-a81f-c4a4fdf578ac admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.604509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:40.620575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.621311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.621438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.621700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.622367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.623938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba3d78-480d-4b8b-8999-0c7688286fae admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.638051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1258/2494] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:40.642380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.653176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73374-347c-4292-91f2-4118303e543d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.658165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.658842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.659121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.659392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] PATH_INFO: `/v3/projects/2a731d8bfc8f46808198935be605a690/users/1291e01070534ca494d8298b76483066/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.661375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a731d8bfc8f46808198935be605a690, user_id=1291e01070534ca494d8298b76483066, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.664023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.674593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1237/2495] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:40 2022] PUT /identity/v3/projects/2a731d8bfc8f46808198935be605a690/users/1291e01070534ca494d8298b76483066/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:40.686111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.686434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.686657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.714082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] MFA Rules not processed for user `1291e01070534ca494d8298b76483066`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:40.715272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:40.781619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1259/2496] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:40.793545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.795264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:40.830830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:40.854683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5cd4-c302-4e2f-81ea-f06900226d0e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.858335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.859016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.859322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.859641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:40.868353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:40.869750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:40.879018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1238/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:40.951380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:40.961586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4002d4-983a-47fd-a298-9b8829e82cd5 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:40.965718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:40.966342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:40.966619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:40.966886 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:41.023953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:41.026008 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223fff0-432d-4bd9-9f75-1343670f69ba service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:41.034622 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1260/2498] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:41.294676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:41.358331 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae736eb-95d3-4461-b3cb-3c4f726fcef2 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:41.362770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:41.363383 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:41.363656 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:41.363912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] PATH_INFO: `/v3/users/a2cb2078529a490ea8867b734705a387` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:41.365035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cb2078529a490ea8867b734705a387)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:41.367075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:41.412975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cb2078529a490ea8867b734705a387'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:41.419414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cb2078529a490ea8867b734705a387'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:41.431113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cb2078529a490ea8867b734705a387'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:41.432238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cb2078529a490ea8867b734705a387'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:41.432836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cb2078529a490ea8867b734705a387'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:41.444667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1239/2499] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:41 2022] DELETE /identity/v3/users/a2cb2078529a490ea8867b734705a387 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:41.449916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:41.450215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:41.450488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:41.468872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:41.470088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:41.526730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1261/2500] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:41.536276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:41.537661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:41.594068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788f33-1058-41cc-b115-4384d8b209fb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:41.597678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:41.598304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:41.598582 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:41.598849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:41.608140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:41.609537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:41.613356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:41.621073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1240/2501] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:41.748897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:41.750326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:41.763073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1b7a-daf4-48f3-9004-99084e62e2fa None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:41.766766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:41.767641 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:41.767921 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:41.768242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:41.769869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:41.782516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:41.785826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:41.787744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:41.798332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1262/2502] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:42.059115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:42.061060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:42.073530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8a59-423e-4823-930f-3b3d55593f9d service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:42.077959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:42.078570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.078842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.079106 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] PATH_INFO: `/v3/projects/a8db8d74300c46c3908246c82b42148b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.080186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8db8d74300c46c3908246c82b42148b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:42.082125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:42.136139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8db8d74300c46c3908246c82b42148b', 'request_id': 'req-018929a5-af8f-4ae8-a0d5-7965cb45a46e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.142543 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8db8d74300c46c3908246c82b42148b', 'request_id': 'req-018929a5-af8f-4ae8-a0d5-7965cb45a46e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.151406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8db8d74300c46c3908246c82b42148b', 'request_id': 'req-018929a5-af8f-4ae8-a0d5-7965cb45a46e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.162358 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] The token cache is being invalidate because project a8db8d74300c46c3908246c82b42148b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:42.162748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.163382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.164858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1241/2503] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:42 2022] DELETE /identity/v3/projects/a8db8d74300c46c3908246c82b42148b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:42.169538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:42.178893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05ec0-e1a1-4c98-9545-a1d4e04439a8 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:42.240330 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:42.241066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.241357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.241623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] PATH_INFO: `/v3/users/1291e01070534ca494d8298b76483066` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.242802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1291e01070534ca494d8298b76483066)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:42.244774 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:42.292618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1291e01070534ca494d8298b76483066'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.300575 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1291e01070534ca494d8298b76483066'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.313526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1291e01070534ca494d8298b76483066'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.320710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1291e01070534ca494d8298b76483066'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.321445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2d4fc17f-3632-42bc-8447-4b9e2f63aa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1291e01070534ca494d8298b76483066'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.327440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1263/2504] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:42 2022] DELETE /identity/v3/users/1291e01070534ca494d8298b76483066 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:42.621421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:42.622761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:42.637277 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018929a5-af8f-4ae8-a0d5-7965cb45a46e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:42.700663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:42.701294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.701632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.701920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] PATH_INFO: `/v3/projects/2a731d8bfc8f46808198935be605a690` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.703070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a731d8bfc8f46808198935be605a690)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:42.705085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:42.755510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a731d8bfc8f46808198935be605a690', 'request_id': 'req-2223e3d6-6e32-4761-87fe-1ca461ff06a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.762449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a731d8bfc8f46808198935be605a690', 'request_id': 'req-2223e3d6-6e32-4761-87fe-1ca461ff06a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.771176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a731d8bfc8f46808198935be605a690', 'request_id': 'req-2223e3d6-6e32-4761-87fe-1ca461ff06a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.781820 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] The token cache is being invalidate because project 2a731d8bfc8f46808198935be605a690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:42.782154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.782784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2223e3d6-6e32-4761-87fe-1ca461ff06a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:42.784272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1242/2505] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:42 2022] DELETE /identity/v3/projects/2a731d8bfc8f46808198935be605a690 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:42.789127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.789596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.789861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.809649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:42.810885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:42.871605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1264/2506] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:42.880556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.881104 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.881669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.904509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:42.905722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:42.915787 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1243/2507] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:42.920068 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:42.929783 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5f680-157c-4a8f-9526-b36aa2b54ea4 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:42.935058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:42.935654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.935929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.936223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.936857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:42.937135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:42.938777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:42.954213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1265/2508] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:42.958816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:42.964567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:42.969353 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ecad1-243f-44f0-a599-e1aa72fe6a39 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:42.977564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:42.978498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:42.978778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:42.979102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:42.979731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:42.981699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.013102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1244/2509] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:42 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:43.017530 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.022702 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:43.030003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bd46f-1606-486e-83ae-11c47dd2ba22 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.094359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.094974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.095249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.095518 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.096151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.098105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.122547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1266/2510] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:43 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:43.126697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.138238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbdba1-acb4-42d4-86f2-1134fae42cc6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.144120 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.144734 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.145004 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.145266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.145915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.147517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.159496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1245/2511] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:43.163744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.176986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ad87-b075-4cf8-85f1-df6415ae8aa3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.183908 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.184975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.185465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.185980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.187160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.189350 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee585-9a9f-45be-b502-714c0953f730 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.202087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1267/2512] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:43.206466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.216849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d20f-41ce-4230-813a-2472b2d54fa4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.221636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.222320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.222616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.222847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] PATH_INFO: `/v3/projects/a4d19e8bd9b84d4b9a0bd2b55977e127/users/dcae921b8c404e91bca6b91c25ffaa7d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.242644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d19e8bd9b84d4b9a0bd2b55977e127, user_id=dcae921b8c404e91bca6b91c25ffaa7d, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.246237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.265485 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1246/2513] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:43 2022] PUT /identity/v3/projects/a4d19e8bd9b84d4b9a0bd2b55977e127/users/dcae921b8c404e91bca6b91c25ffaa7d/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:43.277304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.277466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.278025 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.308585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] MFA Rules not processed for user `dcae921b8c404e91bca6b91c25ffaa7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:43.309776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:43.375785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1268/2514] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:43.387137 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.389060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:43.445499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7725-4459-41db-8e2f-ad4c3a7900db admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.449153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.449749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.450056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.450346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.458982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.460407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f492b9-4a3c-4627-a260-045e0f323405 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.470297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1247/2515] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:43.492270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.575478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efe7d-0842-4205-a53d-1ee5bf29fec3 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.580370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.580753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.581031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.581323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] PATH_INFO: `/v3/users/dcae921b8c404e91bca6b91c25ffaa7d` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.582496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcae921b8c404e91bca6b91c25ffaa7d)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.584450 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.599066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:43.643108 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcae921b8c404e91bca6b91c25ffaa7d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:43.654109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcae921b8c404e91bca6b91c25ffaa7d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:43.668473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcae921b8c404e91bca6b91c25ffaa7d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:43.677441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcae921b8c404e91bca6b91c25ffaa7d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:43.678209 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcae921b8c404e91bca6b91c25ffaa7d'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:43.688379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1269/2516] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:43 2022] DELETE /identity/v3/users/dcae921b8c404e91bca6b91c25ffaa7d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:43.693257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.693552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.693872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.715906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:43.717523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:43.788907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1248/2517] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:43.802773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:43.804425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:43.873580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87b22-a1c4-4287-b420-1e45bb123a20 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:43.891082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:43.891311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:43.891591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:43.891858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:43.902661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:43.904266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1a635-fbe4-43db-94ba-abdfb8ab38da service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:43.915189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1270/2518] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:44.354542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.356077 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:44.373700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539d1f6-b941-4cd3-98d8-c04dfdd10017 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.379983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.380746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.380947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.381281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] PATH_INFO: `/v3/projects/a4d19e8bd9b84d4b9a0bd2b55977e127` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.382638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d19e8bd9b84d4b9a0bd2b55977e127)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.384613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:44.437107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:44.441019 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d19e8bd9b84d4b9a0bd2b55977e127', 'request_id': 'req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:44.448210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d19e8bd9b84d4b9a0bd2b55977e127', 'request_id': 'req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:44.457675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d19e8bd9b84d4b9a0bd2b55977e127', 'request_id': 'req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:44.470919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] The token cache is being invalidate because project a4d19e8bd9b84d4b9a0bd2b55977e127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:44.471562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:44.472020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c4171a5-213a-41f8-8c67-ef5cc83ec82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:44.473683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1249/2519] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:44 2022] DELETE /identity/v3/projects/a4d19e8bd9b84d4b9a0bd2b55977e127 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:44.479214 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.479613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.480004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.500796 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:44.502165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:44.570479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1271/2520] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:44.633728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.633959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.634237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.656624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:44.658178 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:44.666448 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1250/2521] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:44.670757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.683888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b29ef-b041-4036-9f0c-ca350db77c87 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.689115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.689929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.690454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.690841 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.691719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:44.692098 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.693874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:44.707709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1272/2522] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:44.712046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.722725 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2edc06-89c9-459f-88ee-cc7b8c8ba553 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.727843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.728547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.729286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.729286 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.729922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.732060 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:44.765055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1251/2523] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:44 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:44.771304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.784005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067c4a3-1315-432f-9dfb-110e2ec109ef admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.806951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:44.864056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.864999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.865274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.865593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.866254 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.868215 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:44.918119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1273/2524] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:44 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:44.920324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.932239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2db2d1-c055-49a3-9837-4a4b60d33c2b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.938014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.938847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.939289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.939651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.940382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.942758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:44.956952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1252/2525] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:44.959253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:44.975153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f991d79-af9b-4c9e-a1c4-e47682220d1f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:44.982139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:44.982942 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:44.983408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:44.983863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:44.984660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:44.989472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2de15-2c64-4a80-a450-994f2cc30a2b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.011495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1274/2526] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:45.012692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.023957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cf0b8-9c83-47ea-aa51-83a592c94ef1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.029144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.029933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.030287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.030644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] PATH_INFO: `/v3/projects/287afd88bd1448478799ec2639e977dd/users/85b5e462286f4c069fbfce9b87d96b2f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.052748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] RBAC: Authorizing `identity:create_grant(project_id=287afd88bd1448478799ec2639e977dd, user_id=85b5e462286f4c069fbfce9b87d96b2f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.055686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.073938 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1253/2527] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:45 2022] PUT /identity/v3/projects/287afd88bd1448478799ec2639e977dd/users/85b5e462286f4c069fbfce9b87d96b2f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:45.086693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.087320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.087878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.119585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] MFA Rules not processed for user `85b5e462286f4c069fbfce9b87d96b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:45.121125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.221889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1275/2528] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:45.226192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.356233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e563-7735-4e1c-831d-7c29306a078b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.363250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.364784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.366447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.367164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.367542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.367895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.368756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.371429 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.393857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f287a-8479-40d8-b8cb-a9b17f668df9 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.402323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.402693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.402966 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.403235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] PATH_INFO: `/v3/users/7bd39d1cce924d77979ded850bbfbea4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.411024 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1254/2529] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:45.415731 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.421167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd39d1cce924d77979ded850bbfbea4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.423313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.473556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd39d1cce924d77979ded850bbfbea4'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.479113 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:45.482535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd39d1cce924d77979ded850bbfbea4'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.484394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa8f2e-bbdd-4bff-994c-12b344df1070 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.490490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.491167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.491509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.491840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.492515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.495133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.498761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd39d1cce924d77979ded850bbfbea4'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.499934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:45.509373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd39d1cce924d77979ded850bbfbea4'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.510475 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd39d1cce924d77979ded850bbfbea4'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.520779 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1276/2530] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:45 2022] DELETE /identity/v3/users/7bd39d1cce924d77979ded850bbfbea4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:45.520980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1255/2531] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:45.522854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.524199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.595828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bd00d-3b71-4a16-8a16-0fa871dfbe9b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.600589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.601191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.601465 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.601730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.602417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.604084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.614305 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1277/2532] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:45.618605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.628442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c3647-0d68-4dd0-aff4-4ae472ab0c1c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.633052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.633696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.634002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.634271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] PATH_INFO: `/v3/projects/c925d3d28f144eb4b35a306dc7a7df53/users/d9174e627b934334aefb9239f545e077/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.651593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c925d3d28f144eb4b35a306dc7a7df53, user_id=d9174e627b934334aefb9239f545e077, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.654975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.668507 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1256/2533] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:45 2022] PUT /identity/v3/projects/c925d3d28f144eb4b35a306dc7a7df53/users/d9174e627b934334aefb9239f545e077/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:45.672851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.683116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b48949-963f-4562-ab26-18b82218c17d admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.700311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.702071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.753347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.754002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.754281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.754550 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.755190 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.756784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.767941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1278/2534] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:45.772070 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.774641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8197d11-0a0f-4a65-bbad-cd3a94126afe admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.779349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.779972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.780247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.780517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] PATH_INFO: `/v3/projects/829f865a21044020951f494ebc9e6edf` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.782002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7301f3-359d-4b01-bba1-0eeca973ffdb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:45.786693 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:45.787318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.787590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.787855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] PATH_INFO: `/v3/projects/c925d3d28f144eb4b35a306dc7a7df53/users/d9174e627b934334aefb9239f545e077/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.789741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c925d3d28f144eb4b35a306dc7a7df53, user_id=d9174e627b934334aefb9239f545e077, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.791916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829f865a21044020951f494ebc9e6edf)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:45.792436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb222-5c6a-4af9-93ac-3668d2155973 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.793866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:45.803489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1279/2535] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:45 2022] PUT /identity/v3/projects/c925d3d28f144eb4b35a306dc7a7df53/users/d9174e627b934334aefb9239f545e077/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:45.815516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.816105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.816105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.841490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829f865a21044020951f494ebc9e6edf', 'request_id': 'req-931893df-1227-4865-80e4-37faa1b1e9f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.844454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] MFA Rules not processed for user `d9174e627b934334aefb9239f545e077`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:45.845666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.848666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829f865a21044020951f494ebc9e6edf', 'request_id': 'req-931893df-1227-4865-80e4-37faa1b1e9f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.856422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829f865a21044020951f494ebc9e6edf', 'request_id': 'req-931893df-1227-4865-80e4-37faa1b1e9f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.869740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] The token cache is being invalidate because project 829f865a21044020951f494ebc9e6edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:45.870068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.870722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-931893df-1227-4865-80e4-37faa1b1e9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:45.872407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1257/2536] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:45 2022] DELETE /identity/v3/projects/829f865a21044020951f494ebc9e6edf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:45.877175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f07b-a149-403c-a3ba-6ead29938659 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.877533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f07b-a149-403c-a3ba-6ead29938659 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.877862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f07b-a149-403c-a3ba-6ead29938659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.898426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-78f2f07b-a149-403c-a3ba-6ead29938659 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:45.899616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-78f2f07b-a149-403c-a3ba-6ead29938659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.924192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:45.938230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1280/2537] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:45.945446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:45.949741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:45.951460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:45.968541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1258/2538] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:45.976349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:45.976759 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:45.977103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:45.996452 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:45.997691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:46.005693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1259/2539] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:46.010515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.015907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0e3d4-3a14-4e92-a6ec-20c63890f087 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.019516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74e278-462a-4850-a69c-03e12dc0b13e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.020002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.020607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.020882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.021149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.022977 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:46.024134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.024714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.024982 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.025274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.025920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:46.026237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.027862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.039117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1260/2540] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:31:46.043449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.052623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48575df1-ade9-413c-9e2f-3af4f0b21ec8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.057885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.058475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.058752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.059017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.059611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.061461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.084132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.085569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.089578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1261/2541] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:46.093827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.094819 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1281/2542] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:31:46.154930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2657-07b4-4eb7-8cad-b3df69c5ae17 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.159573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.160179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.160446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.160712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.161335 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.163378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.185673 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1262/2543] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:46.189790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.200353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ffc-bba8-4cd7-b927-2c72baecb90b service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.204875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.205469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.205742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.206040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.206675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.208273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.218413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1282/2544] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:46.222774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.234797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a411add-ef88-43f8-b5f8-0aa1935c53f0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.239694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.240301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.240575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.240838 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.241463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.243367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18202f-3aa6-4fd8-ac2f-0c0709121f84 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.254998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1263/2545] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:46.258950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.269821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e6f9-4043-40bd-a36a-f520d53aa919 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.274523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.275297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.275732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.276040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] PATH_INFO: `/v3/projects/8dc9c1490c3a4e3d9b60126dbe533ef6/users/a8208543807a4507b8853758d6a3e398/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.292626 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9c1490c3a4e3d9b60126dbe533ef6, user_id=a8208543807a4507b8853758d6a3e398, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.295519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.309742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1283/2546] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:46 2022] PUT /identity/v3/projects/8dc9c1490c3a4e3d9b60126dbe533ef6/users/a8208543807a4507b8853758d6a3e398/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:46.321215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.321509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.321778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.358581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] MFA Rules not processed for user `a8208543807a4507b8853758d6a3e398`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:46.360257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:46.432261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1264/2547] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:46.436772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.497318 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874004cf-e509-49ea-8b83-584912be6202 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.501992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.502604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.502878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.503146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.503764 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.505808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.524963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:46.533503 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1284/2548] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:46.537572 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.548596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9c3a-f9ce-4d00-863b-7a3691ebe8f5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.553136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:46.604687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.605340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.605602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.605861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.606494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.608384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.629001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1265/2549] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:46.632990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.643313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f15a-488c-4798-8782-10a01d68cf91 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.647840 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.648420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.648690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.648953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.649577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.651700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.661869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1285/2550] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:46.666786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.676826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642c1b-c7d4-414b-a614-7a182d4195ce admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.681349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.682051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.682324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.682588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] PATH_INFO: `/v3/projects/ef503fe79b55482b85a7054297c552aa/users/1c24a32f44bc48d0ab36c2651cef0166/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.698400 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef503fe79b55482b85a7054297c552aa, user_id=1c24a32f44bc48d0ab36c2651cef0166, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.701122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.714192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1266/2551] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:46 2022] PUT /identity/v3/projects/ef503fe79b55482b85a7054297c552aa/users/1c24a32f44bc48d0ab36c2651cef0166/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:46.718155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.728134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f136-d4e8-4b79-b975-76d797b483b9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.782673 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.783270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.783544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.783812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.784438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.786041 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aa689-ec7e-43c1-9c5e-8637d460c54f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.796122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1286/2552] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:46.800310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:46.810384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521fcbd-eb11-491f-92fc-c8d3fbd38c86 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:46.814873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:46.815512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.815784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.816048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] PATH_INFO: `/v3/projects/ef503fe79b55482b85a7054297c552aa/users/1c24a32f44bc48d0ab36c2651cef0166/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.817944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef503fe79b55482b85a7054297c552aa, user_id=1c24a32f44bc48d0ab36c2651cef0166, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:46.820538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:46.830368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1267/2553] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:46 2022] PUT /identity/v3/projects/ef503fe79b55482b85a7054297c552aa/users/1c24a32f44bc48d0ab36c2651cef0166/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:46.840838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:46.841344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:46.841443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:46.870054 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] MFA Rules not processed for user `1c24a32f44bc48d0ab36c2651cef0166`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:46.871242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:46.944875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1287/2554] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:46.956605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:47.009436 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c68f-5e36-4977-be3a-11e5c6174217 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:47.013535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:47.014145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.014421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.014683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.024170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:47.026303 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145c13-4a6a-4c4c-a05e-31667219444b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:47.035628 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1268/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:47.199197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:47.260380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8a6f8-cba8-4318-b453-29192f235faf None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:47.265301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:47.266123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.266404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.266672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] PATH_INFO: `/v3/users/a8208543807a4507b8853758d6a3e398` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.268060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8208543807a4507b8853758d6a3e398)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:47.270040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:47.280536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:47.314250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8208543807a4507b8853758d6a3e398'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.321167 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8208543807a4507b8853758d6a3e398'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.332804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8208543807a4507b8853758d6a3e398'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.339996 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8208543807a4507b8853758d6a3e398'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.340620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8208543807a4507b8853758d6a3e398'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.346357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1288/2556] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:47 2022] DELETE /identity/v3/users/a8208543807a4507b8853758d6a3e398 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:47.350825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.351102 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.351371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.370512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:47.371703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:47.431266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1269/2557] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:47.441016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:47.442440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:47.501680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf75e7-373b-4bc3-ab26-35f077794ee2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:47.505564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:47.506202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.506479 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.506746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.518358 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:47.519792 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:47.529685 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1289/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:47.808644 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:47.810121 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:47.818441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:47.828333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde715-ea34-4a3f-a58a-1eaad7dcef67 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:47.834172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:47.835001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.835140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.835402 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] PATH_INFO: `/v3/projects/8dc9c1490c3a4e3d9b60126dbe533ef6` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.836517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc9c1490c3a4e3d9b60126dbe533ef6)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:47.839032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:47.886034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc9c1490c3a4e3d9b60126dbe533ef6', 'request_id': 'req-a7f51319-2757-44fe-83f8-59628c5ad0b4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.892629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc9c1490c3a4e3d9b60126dbe533ef6', 'request_id': 'req-a7f51319-2757-44fe-83f8-59628c5ad0b4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.901447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc9c1490c3a4e3d9b60126dbe533ef6', 'request_id': 'req-a7f51319-2757-44fe-83f8-59628c5ad0b4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.912023 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] The token cache is being invalidate because project 8dc9c1490c3a4e3d9b60126dbe533ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:47.912306 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.912909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:47.914406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1270/2559] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:47 2022] DELETE /identity/v3/projects/8dc9c1490c3a4e3d9b60126dbe533ef6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:47.918455 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:47.927959 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afbdf2-c592-4a41-9329-f8afb4b67128 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:47.983818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:47.984438 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:47.984713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:47.984982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] PATH_INFO: `/v3/users/1c24a32f44bc48d0ab36c2651cef0166` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:47.986125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c24a32f44bc48d0ab36c2651cef0166)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:47.988030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.023625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:48.036445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c24a32f44bc48d0ab36c2651cef0166'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.043448 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c24a32f44bc48d0ab36c2651cef0166'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.055115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c24a32f44bc48d0ab36c2651cef0166'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.062488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c24a32f44bc48d0ab36c2651cef0166'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.063281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04f03ab2-1b9e-4f4d-825b-f9b92730da46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c24a32f44bc48d0ab36c2651cef0166'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.069030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1290/2560] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:47 2022] DELETE /identity/v3/users/1c24a32f44bc48d0ab36c2651cef0166 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:48.338563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.340013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.354682 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51319-2757-44fe-83f8-59628c5ad0b4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.411751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.412399 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.412634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.412895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] PATH_INFO: `/v3/projects/ef503fe79b55482b85a7054297c552aa` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.414045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef503fe79b55482b85a7054297c552aa)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.416438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.462028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef503fe79b55482b85a7054297c552aa', 'request_id': 'req-0ce77f30-89a2-4848-80fe-e83114ff126c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.468204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef503fe79b55482b85a7054297c552aa', 'request_id': 'req-0ce77f30-89a2-4848-80fe-e83114ff126c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.475418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef503fe79b55482b85a7054297c552aa', 'request_id': 'req-0ce77f30-89a2-4848-80fe-e83114ff126c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.486041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] The token cache is being invalidate because project ef503fe79b55482b85a7054297c552aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:48.486330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.486942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0ce77f30-89a2-4848-80fe-e83114ff126c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.488405 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1271/2561] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:48 2022] DELETE /identity/v3/projects/ef503fe79b55482b85a7054297c552aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:48.493308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.493584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.493848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.513327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:48.514534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.572879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1291/2562] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:48.580600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.580885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.581154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.600633 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:48.601856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.610142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1272/2563] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:48.614270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.624562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c2a62-5de2-46ae-bd9b-f0033061202b None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.629151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.629746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.630047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.630311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.630949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:31:48.631245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.632818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.641729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.643385 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.645488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1292/2564] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:31:48.649467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.659255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a7bc-3abd-433d-b593-602b359037b8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.660027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07920-fcaf-46f6-af8c-851c3db9cc26 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.663915 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.664493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.664763 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.665024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.665317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.665620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.666454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.666729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.666988 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] PATH_INFO: `/v3/users/85b5e462286f4c069fbfce9b87d96b2f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.668048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.668173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b5e462286f4c069fbfce9b87d96b2f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.669987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.674795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:48.697587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1293/2565] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:48.701963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.722412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b5e462286f4c069fbfce9b87d96b2f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.729930 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b5e462286f4c069fbfce9b87d96b2f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.741700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b5e462286f4c069fbfce9b87d96b2f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.742360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b5e462286f4c069fbfce9b87d96b2f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.742993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fbdf9fd1-cb24-4b14-8c99-8e2aaa5f1279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b5e462286f4c069fbfce9b87d96b2f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:48.755869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1273/2566] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:48 2022] DELETE /identity/v3/users/85b5e462286f4c069fbfce9b87d96b2f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:48.760784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.761064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.761332 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.764248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89061bd-8d5d-4f3b-8736-2a23d8060969 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.781390 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:48.782589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:48.782717 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.822816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.823473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.823687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.823950 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.824559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.826507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.841465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1274/2567] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:48.848153 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1294/2568] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/users => generated 278 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:48.852074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.852224 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.853440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.853690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:48.865378 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a0b4-c836-4bcf-81e6-77c2c3c2a248 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.870970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.871579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.871856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.872123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.872758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.876125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.888786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1295/2569] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:48.892308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.902036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1ac8-b8ba-4923-90c1-bddc7433c0e1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.906643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.907221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.907493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.907758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.908380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.909967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.918212 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877442cd-4532-4999-9f4f-132e420e9b8f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.921115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1296/2570] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:31:48.924280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:48.925687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.926334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.926639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.926910 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.934537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9839c-f71d-4e23-a965-60d5db28b4ad admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:48.937165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.938617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57f418-70ac-4c95-814e-c11338cb74fe service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.938979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:48.939616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.939887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.940154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] PATH_INFO: `/v3/projects/2af9ef80e1fe4bfabb1f74c308b3b82f/users/e0a246f5d5984890b605e6f00f99bf1a/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:48.949071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1275/2571] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:48.955355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af9ef80e1fe4bfabb1f74c308b3b82f, user_id=e0a246f5d5984890b605e6f00f99bf1a, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:48.958230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:48.978155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1297/2572] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:48 2022] PUT /identity/v3/projects/2af9ef80e1fe4bfabb1f74c308b3b82f/users/e0a246f5d5984890b605e6f00f99bf1a/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:48.985236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:48.985680 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:48.986413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.028051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] MFA Rules not processed for user `e0a246f5d5984890b605e6f00f99bf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:49.030090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.046941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:49.126049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1276/2573] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:31:49.128713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.204784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e105-3f0b-46e3-bcde-7efd1e838506 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.210243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.210946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.211227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.211477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.212210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.214172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.251558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1298/2574] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:31:49 2022] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:31:49.256371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.269701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.272497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.276729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67dc95-ff15-4b31-ae56-68be7d2f3d9d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.340744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:49.356165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a82a6-67ac-4fe8-8754-ec58ebd31b0e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.356772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.357391 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.357701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.357998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.358611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.361527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.363798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.364435 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.364711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.364987 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] PATH_INFO: `/v3/projects/287afd88bd1448478799ec2639e977dd` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.366139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287afd88bd1448478799ec2639e977dd)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.368032 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.386617 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1277/2575] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:31:49 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:31:49.390632 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.402031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27329-7e8b-4b09-8094-889cb37c7725 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.407616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.408267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.408889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.408889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.409527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.411398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.426022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1278/2576] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:49.430920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.437085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287afd88bd1448478799ec2639e977dd', 'request_id': 'req-6fcdeda0-886a-463c-8717-3bf9ae822048'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.442552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23033a1c-8121-44e7-95dd-22bfbd1cc3d0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.446029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287afd88bd1448478799ec2639e977dd', 'request_id': 'req-6fcdeda0-886a-463c-8717-3bf9ae822048'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.453515 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287afd88bd1448478799ec2639e977dd', 'request_id': 'req-6fcdeda0-886a-463c-8717-3bf9ae822048'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.464655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] The token cache is being invalidate because project 287afd88bd1448478799ec2639e977dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:49.464946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.465979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.467468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1299/2577] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:49 2022] DELETE /identity/v3/projects/287afd88bd1448478799ec2639e977dd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:49.471370 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.472680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.505550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.506260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.506534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.506803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] PATH_INFO: `/v3/projects/0cb22865c9f649b8ae5a621bdb807533/users/b2e6e6a5d30b40bdb19243f0c1312454/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.521479 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb22865c9f649b8ae5a621bdb807533, user_id=b2e6e6a5d30b40bdb19243f0c1312454, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.524171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.538203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1279/2578] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:49 2022] PUT /identity/v3/projects/0cb22865c9f649b8ae5a621bdb807533/users/b2e6e6a5d30b40bdb19243f0c1312454/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:49.542796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.543134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdeda0-886a-463c-8717-3bf9ae822048 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.544376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.563434 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:49.599889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.600545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.600824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.601092 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] PATH_INFO: `/v3/users/d9174e627b934334aefb9239f545e077` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.602260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9174e627b934334aefb9239f545e077)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.604824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.609384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2f871-2c30-48cf-b118-63ab8d6a70d3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.614784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.615789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.616069 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.616333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.616963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.618562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.628329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1280/2579] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:31:49.632931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.638134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:49.643862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-25bc-4bcc-b850-3189f92fd752 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.648655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.649324 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.649601 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.649871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] PATH_INFO: `/v3/projects/0cb22865c9f649b8ae5a621bdb807533/users/b2e6e6a5d30b40bdb19243f0c1312454/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.652354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb22865c9f649b8ae5a621bdb807533, user_id=b2e6e6a5d30b40bdb19243f0c1312454, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.655051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9174e627b934334aefb9239f545e077'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.655205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe88d6-9d38-44fc-9c43-7e5123fdad1c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.662759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9174e627b934334aefb9239f545e077'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.666517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1281/2580] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:31:49 2022] PUT /identity/v3/projects/0cb22865c9f649b8ae5a621bdb807533/users/b2e6e6a5d30b40bdb19243f0c1312454/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:49.677179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.677624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.677955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.678159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9174e627b934334aefb9239f545e077'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.685670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9174e627b934334aefb9239f545e077'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.686433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9174e627b934334aefb9239f545e077'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:49.693492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1300/2581] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:49 2022] DELETE /identity/v3/users/d9174e627b934334aefb9239f545e077 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:49.707569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] MFA Rules not processed for user `b2e6e6a5d30b40bdb19243f0c1312454`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:31:49.708781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.779794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1282/2582] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:31:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:31:49.790917 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.792666 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.854827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1358c1-76bd-43b6-85fd-a5fade7f800e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.858586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.859262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.859537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.859831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.869580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:49.871067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:49.887078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1301/2583] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:49.962573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.972465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a42e81-faed-48e1-a970-cec66abda16e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:49.976307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:49.977043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:49.977382 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:49.977720 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:49.980363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:49.982088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:49.983869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:50.051718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9538abc-d5bf-4474-80ae-a4d440cb852c service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:50.056342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:50.057647 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:50.057946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:50.058227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] PATH_INFO: `/v3/projects/c925d3d28f144eb4b35a306dc7a7df53` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:50.059440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c925d3d28f144eb4b35a306dc7a7df53)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:50.060785 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:50.061341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:50.062315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:50.072280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1283/2584] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:50.107556 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c925d3d28f144eb4b35a306dc7a7df53', 'request_id': 'req-5a749fb8-4952-40eb-87e5-011c0851849b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:50.109967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:50.115594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c925d3d28f144eb4b35a306dc7a7df53', 'request_id': 'req-5a749fb8-4952-40eb-87e5-011c0851849b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:50.125304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c925d3d28f144eb4b35a306dc7a7df53', 'request_id': 'req-5a749fb8-4952-40eb-87e5-011c0851849b'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:50.136593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] The token cache is being invalidate because project c925d3d28f144eb4b35a306dc7a7df53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:31:50.136880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:50.137540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:50.139160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1302/2585] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:49 2022] DELETE /identity/v3/projects/c925d3d28f144eb4b35a306dc7a7df53 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:31:56.098990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:56.100342 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:56.127872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:31:56.156653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7033f6-d810-445a-8c5f-df668a04936a service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:56.202836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:56.203433 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:56.203704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:56.203968 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:56.205645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:56.265975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:56.267629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:56.277478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1284/2586] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:59.419436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:59.427543 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:59.503215 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:59.505144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:59.532494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bad3-e4df-4cee-a471-1073eafd8b86 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:59.535140 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a749fb8-4952-40eb-87e5-011c0851849b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:59.538557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:59.539185 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:59.539458 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:59.539723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] PATH_INFO: `/v3/users/e002e42dfdf446b49fd421f55c8cee25` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:59.540316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:59.540881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e002e42dfdf446b49fd421f55c8cee25)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:59.541007 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:59.541244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:59.541524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:59.542946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:59.544341 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:31:59.555820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:59.557946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:59.568122 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1303/2587] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:31:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:31:59.599678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e002e42dfdf446b49fd421f55c8cee25'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.608414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e002e42dfdf446b49fd421f55c8cee25'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.620756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e002e42dfdf446b49fd421f55c8cee25'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.621496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e002e42dfdf446b49fd421f55c8cee25'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.622278 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7dc43092-535d-4ff2-af2f-a8baa5409875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e002e42dfdf446b49fd421f55c8cee25'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.640449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1285/2588] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:31:59 2022] DELETE /identity/v3/users/e002e42dfdf446b49fd421f55c8cee25 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:31:59.846669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:31:59.859558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73816-535f-4590-97a7-213427fd9daf service placement] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:31:59.928437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:31:59.929036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:31:59.929307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:31:59.929604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] PATH_INFO: `/v3/projects/7dde615a554d4496ab2c516764e4a858` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:31:59.930728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dde615a554d4496ab2c516764e4a858)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:31:59.933277 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:31:59.978111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dde615a554d4496ab2c516764e4a858', 'request_id': 'req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.986236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dde615a554d4496ab2c516764e4a858', 'request_id': 'req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.992279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dde615a554d4496ab2c516764e4a858', 'request_id': 'req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:31:59.999151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:00.003516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] The token cache is being invalidate because project 7dde615a554d4496ab2c516764e4a858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:00.003854 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:00.004739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d9b3dab2-9d31-4be9-af92-4d0fe97d3222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:00.006660 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1304/2589] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:31:59 2022] DELETE /identity/v3/projects/7dde615a554d4496ab2c516764e4a858 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:00.011635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.011917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.012186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.020154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:00.035092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:00.036275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:00.094367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1286/2590] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:00.102181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.102491 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.102786 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.122436 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:00.123625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:00.131419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1305/2591] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:00.135521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.145203 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ffc7a-fe78-44ac-82bd-2dd2559e8e6b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.149661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.150771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.151040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.151305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.151933 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:00.152228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.153816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.165352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1287/2592] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:00.170139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.179211 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01875ca6-1197-4746-b3ce-2515761f81d6 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.183798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.184374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.184644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.184904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.185511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.187410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.214141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1306/2593] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:00 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:00.218336 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.229825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a726e1-1a04-47b8-8d4c-f3c527bad9d0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.284652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.285228 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.285506 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.285772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.286422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.288312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.308749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1288/2594] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:00 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:00.313019 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.323397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5bb3-1511-4666-87e6-dc9a0c6a00b8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.328026 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.328615 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.328884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.329146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.329770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.331397 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.341570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1307/2595] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:00.345271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.355699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a51c-ddc2-4936-82d8-a827af9632a1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.360307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.360888 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.361168 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.361439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.362110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.363712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ca51b-e4de-4c87-9f0f-1b113e1f5f9f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.374124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1289/2596] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:00.378160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.388494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b548-14ee-4558-92e3-d84ac718421a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.393339 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.394011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.394289 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.394557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] PATH_INFO: `/v3/projects/c4bb4b9f9b9144d0b29baf9e2645e0ac/users/8cf912a123ca4904a08ff49cf5cefd96/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.409297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bb4b9f9b9144d0b29baf9e2645e0ac, user_id=8cf912a123ca4904a08ff49cf5cefd96, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.411963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.424081 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1308/2597] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:00 2022] PUT /identity/v3/projects/c4bb4b9f9b9144d0b29baf9e2645e0ac/users/8cf912a123ca4904a08ff49cf5cefd96/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:00.435369 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.435655 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.435931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.465381 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] MFA Rules not processed for user `8cf912a123ca4904a08ff49cf5cefd96`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:00.466609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:00.523781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:00.530243 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1290/2598] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:00.541789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.543492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:00.617569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20782165-e1bd-4617-a830-81d2d44cd55e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.623147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.623736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.624011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.624276 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.631750 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.633326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799ee69-2d8f-4894-ad89-b375b9ce711b service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.642614 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1309/2599] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:00.853056 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:00.917567 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86952-ecf6-4c9c-802e-787fe4674b93 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:00.922861 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:00.923517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:00.923783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:00.924050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] PATH_INFO: `/v3/users/8cf912a123ca4904a08ff49cf5cefd96` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:00.925754 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf912a123ca4904a08ff49cf5cefd96)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:00.927681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:00.978034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf912a123ca4904a08ff49cf5cefd96'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:00.985779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf912a123ca4904a08ff49cf5cefd96'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:00.999472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf912a123ca4904a08ff49cf5cefd96'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.000138 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf912a123ca4904a08ff49cf5cefd96'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.000758 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf912a123ca4904a08ff49cf5cefd96'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.014167 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1291/2600] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:00 2022] DELETE /identity/v3/users/8cf912a123ca4904a08ff49cf5cefd96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:01.018788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.019075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.019347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.037778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:01.038988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:01.099024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1310/2601] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:01.109322 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.110796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:01.167330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6cbb-f77c-4ba0-979e-e69c5d8c8f44 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.171041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.171636 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.171911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.172179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.180927 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.182973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b47427-41ae-4fb7-a8ca-93fc328b09be service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.192204 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1292/2602] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:01.481293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.482935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:01.494879 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eb06f-bb41-466d-bb9e-6908b7a4b938 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.499451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.500072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.500343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.500609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] PATH_INFO: `/v3/projects/c4bb4b9f9b9144d0b29baf9e2645e0ac` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.501700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bb4b9f9b9144d0b29baf9e2645e0ac)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.503674 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.520426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:01.550670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bb4b9f9b9144d0b29baf9e2645e0ac', 'request_id': 'req-a79e84df-d415-47f1-a71d-3974ae809169'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.558533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bb4b9f9b9144d0b29baf9e2645e0ac', 'request_id': 'req-a79e84df-d415-47f1-a71d-3974ae809169'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.564578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bb4b9f9b9144d0b29baf9e2645e0ac', 'request_id': 'req-a79e84df-d415-47f1-a71d-3974ae809169'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.574548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] The token cache is being invalidate because project c4bb4b9f9b9144d0b29baf9e2645e0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:01.574830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.575445 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a79e84df-d415-47f1-a71d-3974ae809169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:01.576876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1311/2603] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:01 2022] DELETE /identity/v3/projects/c4bb4b9f9b9144d0b29baf9e2645e0ac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:01.581864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.582538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.582538 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.601702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:01.602913 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:01.615963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:01.662066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1293/2604] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:01.670517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.670800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.671067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.690470 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:01.691836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:01.700198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1312/2605] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:01.704541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.714702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b423c7-7708-48d0-87af-e3bdd14d8359 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.719146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.719740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.720016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.720284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.720922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:01.721220 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.722830 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.734775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1294/2606] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:01.738971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.748011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67688f3-e49c-4e19-be9e-e570b17c9f56 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.752613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.753196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.753469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.753740 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.754381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.756268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.785009 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1313/2607] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:01.789165 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.799647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d10067-1d64-41c8-afbb-020ae96c9b8c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.853994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.854623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.854901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.855169 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.855784 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.857684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.878490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1295/2608] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:01 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:01.882927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.894121 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54a993-8fd4-4206-9268-57cba1103a1b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.898716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.899302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.899572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.899830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.901114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.902712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.912402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1314/2609] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:01.916404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.926267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80bab8-fd64-4c52-85c8-d7bbd891029c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.930961 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.931629 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.931906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.932174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.932807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.934406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af155-d61e-4415-8803-1e36a8086adf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.944675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1296/2610] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:01.949100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:01.958941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacc876-ac24-4510-bbf1-345ea3cb6ca4 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:01.964106 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:01.964741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:01.965011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:01.965275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] PATH_INFO: `/v3/projects/b2377a03c1bd436581a3a3f67dec02f7/users/d564db143c7b4c49a0b8226b44918e00/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:01.979661 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2377a03c1bd436581a3a3f67dec02f7, user_id=d564db143c7b4c49a0b8226b44918e00, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:01.982354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:01.994986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1315/2611] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:01 2022] PUT /identity/v3/projects/b2377a03c1bd436581a3a3f67dec02f7/users/d564db143c7b4c49a0b8226b44918e00/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:02.011361 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.011639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.011903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.039850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] MFA Rules not processed for user `d564db143c7b4c49a0b8226b44918e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:02.041079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:02.104244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1297/2612] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:02.109151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.181612 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd7f1-8775-43b9-b250-35019b5d60c7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.187709 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.188325 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.188604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.188874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.189500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.191408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.225002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1316/2613] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:02 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:02.226266 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.238193 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782427-f822-49f2-9587-3d7299c39d4b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.250109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:02.299960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.300578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.300856 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.301125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.301746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.303681 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.327546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1298/2614] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:02 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:02.331805 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.343975 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f15de-ce0e-4d51-822f-4e1b9c67415b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.348863 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.349464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.349743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.350040 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.350682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.352384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.363322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1317/2615] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:02.367494 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.378539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefcca-494a-4402-8f78-6d085db2df93 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.383183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.383822 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.384095 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.384467 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] PATH_INFO: `/v3/projects/ff9b4d99db094430bd3c89a7f29e661b/users/638d69a9c0624aecb221f62bb0f67a97/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.400333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9b4d99db094430bd3c89a7f29e661b, user_id=638d69a9c0624aecb221f62bb0f67a97, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.403012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.417890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1299/2616] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:02 2022] PUT /identity/v3/projects/ff9b4d99db094430bd3c89a7f29e661b/users/638d69a9c0624aecb221f62bb0f67a97/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:02.421823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.432085 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9646fa-e5ee-4507-8e1c-4027b2960a75 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.444559 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:02.491554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.492354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.492489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.492670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.493302 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.495453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cfed4-a8c8-4720-8ac1-6d2e21615153 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.505338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1318/2617] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:02.509527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.520564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b534d-1260-4a6b-95d2-7fb4a3e5e4e3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.525263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.525937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.526214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.526478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] PATH_INFO: `/v3/projects/ff9b4d99db094430bd3c89a7f29e661b/users/638d69a9c0624aecb221f62bb0f67a97/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.528413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9b4d99db094430bd3c89a7f29e661b, user_id=638d69a9c0624aecb221f62bb0f67a97, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.531183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.542588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1300/2618] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:02 2022] PUT /identity/v3/projects/ff9b4d99db094430bd3c89a7f29e661b/users/638d69a9c0624aecb221f62bb0f67a97/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:02.552756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.553043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.553319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.581164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] MFA Rules not processed for user `638d69a9c0624aecb221f62bb0f67a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:02.582391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:02.654824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1319/2619] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:02.665445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:02.667865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:02.733873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a863-d8dc-48c1-98b9-380cf3c0bdd8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:02.737843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:02.738677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:02.739088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:02.739521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:02.805976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:02.808012 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14e54-f41a-44f3-a0ac-594e56a67d02 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:02.817691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1301/2620] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:05.054223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:05.055665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:05.120790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66047d9-61f5-40b9-ae97-089b400d709e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:05.125343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:05.125992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:05.126272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:05.126542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] PATH_INFO: `/v3/users/e0a246f5d5984890b605e6f00f99bf1a` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:05.127665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a246f5d5984890b605e6f00f99bf1a)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:05.129773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:05.172597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:05.179632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a246f5d5984890b605e6f00f99bf1a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.187240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a246f5d5984890b605e6f00f99bf1a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.200936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a246f5d5984890b605e6f00f99bf1a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.208207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a246f5d5984890b605e6f00f99bf1a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.208910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a246f5d5984890b605e6f00f99bf1a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.215551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1320/2621] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:05 2022] DELETE /identity/v3/users/e0a246f5d5984890b605e6f00f99bf1a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:05.220569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:05.221040 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:05.221163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:05.240022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:05.241231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:05.259249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:05.307114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1302/2622] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:05.316694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:05.318102 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:05.374971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b5784-0d9e-4092-85a5-532818ea47f7 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:05.378628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:05.379231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:05.379511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:05.379776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:05.389498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:05.390953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:05.400618 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1321/2623] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:05.665526 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:05.667460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:05.680079 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff038ae-1b0f-49a8-b16c-6284b0d5ae5d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:05.686683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:05.687352 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:05.687751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:05.687976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] PATH_INFO: `/v3/projects/2af9ef80e1fe4bfabb1f74c308b3b82f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:05.689307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af9ef80e1fe4bfabb1f74c308b3b82f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:05.691356 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:05.738108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af9ef80e1fe4bfabb1f74c308b3b82f', 'request_id': 'req-40447adc-bf12-454e-9157-924fd825eb4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.744708 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af9ef80e1fe4bfabb1f74c308b3b82f', 'request_id': 'req-40447adc-bf12-454e-9157-924fd825eb4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.752067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af9ef80e1fe4bfabb1f74c308b3b82f', 'request_id': 'req-40447adc-bf12-454e-9157-924fd825eb4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.762477 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] The token cache is being invalidate because project 2af9ef80e1fe4bfabb1f74c308b3b82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:05.762763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.763379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.764836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1303/2624] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:05 2022] DELETE /identity/v3/projects/2af9ef80e1fe4bfabb1f74c308b3b82f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:05.769030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:05.778524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7a70-469e-48be-baab-77f81eacd44a service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:05.834049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:05.834668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:05.834941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:05.835207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] PATH_INFO: `/v3/users/b2e6e6a5d30b40bdb19243f0c1312454` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:05.836343 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e6e6a5d30b40bdb19243f0c1312454)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:05.838265 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:05.883496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e6e6a5d30b40bdb19243f0c1312454'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.895017 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e6e6a5d30b40bdb19243f0c1312454'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.900293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:05.907985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e6e6a5d30b40bdb19243f0c1312454'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.914916 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e6e6a5d30b40bdb19243f0c1312454'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.916023 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-677a7afe-ab8d-45aa-835f-b178ac3de9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e6e6a5d30b40bdb19243f0c1312454'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:05.922593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1322/2625] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:05 2022] DELETE /identity/v3/users/b2e6e6a5d30b40bdb19243f0c1312454 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:06.189394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.190849 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:06.204064 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40447adc-bf12-454e-9157-924fd825eb4e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.260775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.261418 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.261660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.261963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] PATH_INFO: `/v3/projects/0cb22865c9f649b8ae5a621bdb807533` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.263052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb22865c9f649b8ae5a621bdb807533)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.264956 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.311327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:06.312797 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb22865c9f649b8ae5a621bdb807533', 'request_id': 'req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:06.320678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb22865c9f649b8ae5a621bdb807533', 'request_id': 'req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:06.328728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb22865c9f649b8ae5a621bdb807533', 'request_id': 'req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:06.340449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] The token cache is being invalidate because project 0cb22865c9f649b8ae5a621bdb807533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:06.340792 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:06.341367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9bf6bf0e-31f0-4e85-abde-8c014fbd44c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:06.342886 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1304/2626] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:06 2022] DELETE /identity/v3/projects/0cb22865c9f649b8ae5a621bdb807533 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:06.347871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.348342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.348571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.369175 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:06.370368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:06.439643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1323/2627] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:06.448986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.449270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.449727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.470338 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:06.471528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:06.479329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1305/2628] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:06.483473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.492870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103eebf-4fb3-4265-bb62-aa9e87a7a459 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.497396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.498016 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.498287 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.498551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.499207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:06.499500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.501080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.513663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1324/2629] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:06.518142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.527697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2050-30d5-4831-9902-ec989632f862 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.532290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.532894 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.533164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.533428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.534086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.535958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.562042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1306/2630] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:06.566270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.576625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ff22-d354-478c-9ca0-575f377c0155 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.631069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.631588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.631858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.632120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.632737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.635179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.655843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1325/2631] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:06.660189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.670260 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86b43-f225-4f1b-ac68-85030ae82584 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.674832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.675420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.675694 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.675960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.676591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.678195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.688119 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1307/2632] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:06.692224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.702940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99905-b376-47cc-8373-11819a66ebb0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.707523 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.708083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.708354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.708619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.709245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.710856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca908f7-1c72-4f72-a6fd-5e58151ff85d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.721812 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1326/2633] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:06.725770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.735646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d47cc-3578-4445-a410-57300381de4c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.740377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.741016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.741291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.741557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] PATH_INFO: `/v3/projects/a79f66e97b0148268af78c28852ff226/users/94a136c0a1424b73b6c3492dd61a08f3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.756117 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79f66e97b0148268af78c28852ff226, user_id=94a136c0a1424b73b6c3492dd61a08f3, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.758931 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.772242 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1308/2634] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:06 2022] PUT /identity/v3/projects/a79f66e97b0148268af78c28852ff226/users/94a136c0a1424b73b6c3492dd61a08f3/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:06.782360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.782642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.782911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.809857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] MFA Rules not processed for user `94a136c0a1424b73b6c3492dd61a08f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:06.811082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:06.842727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:06.876301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1327/2635] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:06.880779 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.942160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957fa6e-c73a-4adb-b1dd-f86fd882d0f4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:06.947572 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:06.948170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:06.948450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:06.948743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:06.949372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:06.951301 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:06.976986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1309/2636] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:06.981220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:06.991824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eabb8-bda4-4638-97c9-737ea3e9d461 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.046766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.047352 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.047637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.047892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.048499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.050418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.071609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1328/2637] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:06 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:07.076200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.087067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271aa53-dee2-4dfe-a858-c070e0ae8bf6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.091821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.092411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.092686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.092955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.093662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.095294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.106311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1310/2638] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:07.110261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.120591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba604587-962e-462a-b6a1-ceb3d04d953e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.125154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.125776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.126079 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.126345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] PATH_INFO: `/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52/users/f17101b6f2e043c08b484d37af0273ec/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.141735 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d80b7ace0c4aba933bd4bdb287dd52, user_id=f17101b6f2e043c08b484d37af0273ec, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.144584 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.156867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1329/2639] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:07 2022] PUT /identity/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52/users/f17101b6f2e043c08b484d37af0273ec/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:07.160722 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.171127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b00af-cd5e-48dd-a87b-c8431f0c378b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.215183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:07.230209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.230807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.231081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.231345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.231974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.233536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4fd3-60b0-4233-a651-d50774d5ce3b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.243318 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1311/2640] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:07.248112 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.258236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a49d0-7565-4cac-9f90-4e26bcade4ab admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.262895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.263522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.263793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.264059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] PATH_INFO: `/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52/users/f17101b6f2e043c08b484d37af0273ec/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.265946 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d80b7ace0c4aba933bd4bdb287dd52, user_id=f17101b6f2e043c08b484d37af0273ec, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.268790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.280249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1330/2641] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:07 2022] PUT /identity/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52/users/f17101b6f2e043c08b484d37af0273ec/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:07.291195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.291723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.291869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.320584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] MFA Rules not processed for user `f17101b6f2e043c08b484d37af0273ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:07.321825 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:07.387478 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1312/2642] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:07.398923 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.400636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:07.458181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75176-4000-48dc-97ae-ed4d5adcdb7f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.461789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.462920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.463203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.463471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.472620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.474072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.484396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1331/2643] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:07.558937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:07.568545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451109b6-7024-4fa1-ad95-99cb56bb34bf None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:07.572712 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:07.573314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:07.573591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:07.573860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:07.632890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:07.634364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:07.643721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1313/2644] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:09.513148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:09.522184 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e151d-8cf9-49f4-818c-04596eb258c4 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:09.526473 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:09.527060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:09.527332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:09.527596 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:09.529328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:09.555613 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:09.593743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:09.595242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12050040-7e73-45e5-b070-f7659df2e0b7 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:09.605281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1332/2645] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:10.365108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:10.426760 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cce03-aa50-4f6c-b87f-ca8b2e2a1be8 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:10.431870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:10.432491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:10.432767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:10.433028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] PATH_INFO: `/v3/users/94a136c0a1424b73b6c3492dd61a08f3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:10.434159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a136c0a1424b73b6c3492dd61a08f3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:10.436043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:10.441470 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:10.483380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a136c0a1424b73b6c3492dd61a08f3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:10.490591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a136c0a1424b73b6c3492dd61a08f3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:10.502325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a136c0a1424b73b6c3492dd61a08f3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:10.502950 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a136c0a1424b73b6c3492dd61a08f3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:10.503544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a136c0a1424b73b6c3492dd61a08f3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:10.515348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1314/2646] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:10 2022] DELETE /identity/v3/users/94a136c0a1424b73b6c3492dd61a08f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:10.520107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:10.520589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:10.520684 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:10.539489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:10.541335 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:10.597387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1333/2647] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:10.608225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:10.609630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:10.665016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27145855-81f8-4173-88ed-1c5dd2fd83f8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:10.669156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:10.669745 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:10.670051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:10.670319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:10.679111 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:10.680504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:10.690439 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1315/2648] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:10.958084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:10.959539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:10.980717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fa86a-283e-47f9-bc29-e9421e792273 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:10.985207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:10.985771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:10.986080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:10.986347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] PATH_INFO: `/v3/projects/a79f66e97b0148268af78c28852ff226` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:10.987423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79f66e97b0148268af78c28852ff226)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:10.989307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.036355 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79f66e97b0148268af78c28852ff226', 'request_id': 'req-a398c933-d08c-4a05-be89-00f521beb199'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.043279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79f66e97b0148268af78c28852ff226', 'request_id': 'req-a398c933-d08c-4a05-be89-00f521beb199'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.049294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79f66e97b0148268af78c28852ff226', 'request_id': 'req-a398c933-d08c-4a05-be89-00f521beb199'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.060889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] The token cache is being invalidate because project a79f66e97b0148268af78c28852ff226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:11.061166 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.061773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.063246 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1334/2649] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:10 2022] DELETE /identity/v3/projects/a79f66e97b0148268af78c28852ff226 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:11.067374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.077308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f5fab-0818-4fab-b096-810f5024980f service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.138292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.138920 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.139197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.139463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] PATH_INFO: `/v3/users/f17101b6f2e043c08b484d37af0273ec` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.140596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17101b6f2e043c08b484d37af0273ec)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.142525 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.177688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:11.193737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17101b6f2e043c08b484d37af0273ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.202314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17101b6f2e043c08b484d37af0273ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.218495 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17101b6f2e043c08b484d37af0273ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.219317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17101b6f2e043c08b484d37af0273ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.219996 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b329268c-298f-4bcf-ae1a-b18fcd0eeafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17101b6f2e043c08b484d37af0273ec'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.232672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1316/2650] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:11 2022] DELETE /identity/v3/users/f17101b6f2e043c08b484d37af0273ec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:11.504304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.505773 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:11.519846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398c933-d08c-4a05-be89-00f521beb199 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.563158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:11.577446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.578105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.578386 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.578657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] PATH_INFO: `/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.579755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d80b7ace0c4aba933bd4bdb287dd52)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.581721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.627411 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d80b7ace0c4aba933bd4bdb287dd52', 'request_id': 'req-2e7e0457-481c-4d59-9153-0369d103c50a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.634663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d80b7ace0c4aba933bd4bdb287dd52', 'request_id': 'req-2e7e0457-481c-4d59-9153-0369d103c50a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.640670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d80b7ace0c4aba933bd4bdb287dd52', 'request_id': 'req-2e7e0457-481c-4d59-9153-0369d103c50a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.650816 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] The token cache is being invalidate because project 52d80b7ace0c4aba933bd4bdb287dd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:11.651096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.651718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e7e0457-481c-4d59-9153-0369d103c50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:11.653148 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1335/2651] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:11 2022] DELETE /identity/v3/projects/52d80b7ace0c4aba933bd4bdb287dd52 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:11.658028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.658512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.658614 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.678101 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:11.679291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:11.738921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1317/2652] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:11.748143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.748428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.748700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.767986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:11.769181 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:11.777021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1336/2653] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:11.781349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.791416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859619b8-53bd-460b-9bfc-9f549c55ffa3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.796003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.796594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.796871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.797142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.797783 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:11.798110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.799692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.811667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1318/2654] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:11.815825 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.824939 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce88e92-aa16-49b3-b082-f9faa6b9aba7 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.829571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.830192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.830471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.830737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.831369 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.833281 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.860593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1337/2655] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:11 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:11.864774 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.875229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba7359-ea38-40e2-8e68-db5902e7fd17 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.930854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.932075 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.932367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.932638 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.933253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.935229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.955284 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1319/2656] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:11 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:11.959307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:11.969964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5567fb-2ab7-4e1b-b059-d70157e4ed04 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:11.974788 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:11.975376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:11.975648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:11.975910 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:11.976537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:11.978710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:11.989120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1338/2657] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:11.996713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.003081 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14db7-4798-481e-9f19-5c98a784b82b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.007897 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.008492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.008763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.009026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.009658 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.011343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54478-d750-4557-979e-6fd687618109 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.021581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1320/2658] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:12.026255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.036220 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67205a3b-ba66-4f4d-a0b5-567114b9b1d1 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.041517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.042227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.042500 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.042878 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] PATH_INFO: `/v3/projects/e241aae9188144a6b71a6c7c76a8665f/users/ec5239d2f8b545fdb36078ab760114ed/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.056951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e241aae9188144a6b71a6c7c76a8665f, user_id=ec5239d2f8b545fdb36078ab760114ed, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.059598 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.072489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1339/2659] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:12 2022] PUT /identity/v3/projects/e241aae9188144a6b71a6c7c76a8665f/users/ec5239d2f8b545fdb36078ab760114ed/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:12.082481 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.082764 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.083049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.109750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:12.112917 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] MFA Rules not processed for user `ec5239d2f8b545fdb36078ab760114ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:12.114768 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:12.178416 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1321/2660] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:12.182875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.244164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa30f-9979-4aa2-a2ce-6662355e7ac6 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.248922 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.249513 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.249787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.250101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.250708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.252577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.271793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:12.279856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1340/2661] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:12 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:12.283805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.303587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefed48-abeb-461d-b4c5-56d7c7aa793b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.364749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.365276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.365555 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.365827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.366504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.368412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.391447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1322/2662] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:12 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:12.395990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.407406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470e85b-429c-42ea-88ad-4dca1b41508a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.412049 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.412649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.412927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.413200 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.413847 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.415494 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.427059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1341/2663] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:12.431271 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.441160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6e81-0c9e-4b57-badb-05367996bdcb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.446093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.446588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.447393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.447667 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] PATH_INFO: `/v3/projects/faeefa4d71a24a75b9d1de51610f1c55/users/c5c71f33e6fb4284b4563558c5762b82/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.463372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeefa4d71a24a75b9d1de51610f1c55, user_id=c5c71f33e6fb4284b4563558c5762b82, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.466028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.479044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1323/2664] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:12 2022] PUT /identity/v3/projects/faeefa4d71a24a75b9d1de51610f1c55/users/c5c71f33e6fb4284b4563558c5762b82/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:12.482943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.493047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed7b1-b2da-4720-8cf0-338ef7118d28 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.547644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.548233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.548506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.548770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.549389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.550984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1b1eb-85f6-45cf-a404-393d4338abf1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.560558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1342/2665] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:12.564622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.575219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4103e-4796-4716-8f8e-1b80273b910b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.579741 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.580374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.580649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.580919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] PATH_INFO: `/v3/projects/faeefa4d71a24a75b9d1de51610f1c55/users/c5c71f33e6fb4284b4563558c5762b82/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.582866 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeefa4d71a24a75b9d1de51610f1c55, user_id=c5c71f33e6fb4284b4563558c5762b82, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.585471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.596123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1324/2666] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:12 2022] PUT /identity/v3/projects/faeefa4d71a24a75b9d1de51610f1c55/users/c5c71f33e6fb4284b4563558c5762b82/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:12.606853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.607359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.607471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.633836 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] MFA Rules not processed for user `c5c71f33e6fb4284b4563558c5762b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:12.635482 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:12.703919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1343/2667] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:12.715131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:12.716991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:12.772816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacee97-35b0-48c5-933e-42344517e034 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:12.776401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:12.776983 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:12.777255 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:12.777520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:12.786200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:12.787602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70fd50-33ae-4a96-89c2-38316433f54a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:12.791711 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:12.799256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1325/2668] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:14.130405 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:14.195155 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a4c1-3ead-4a71-a777-24537b467184 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:14.200298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:14.200919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:14.201196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:14.201466 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] PATH_INFO: `/v3/users/ec5239d2f8b545fdb36078ab760114ed` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:14.202592 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5239d2f8b545fdb36078ab760114ed)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:14.204726 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:14.215983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:14.249248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5239d2f8b545fdb36078ab760114ed'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.256088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5239d2f8b545fdb36078ab760114ed'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.268765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5239d2f8b545fdb36078ab760114ed'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.275525 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5239d2f8b545fdb36078ab760114ed'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.276151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5239d2f8b545fdb36078ab760114ed'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.282234 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1344/2669] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:14 2022] DELETE /identity/v3/users/ec5239d2f8b545fdb36078ab760114ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:14.286670 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:14.287134 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:14.287233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:14.305437 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:14.307122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:14.362721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1326/2670] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:14.372751 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:14.374169 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:14.429930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eba0e0-68ba-4790-958c-fb5e67509de9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:14.434110 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:14.434696 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:14.434968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:14.435230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:14.443988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:14.445441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:14.455381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1345/2671] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:14.725923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:14.727345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:14.741790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b030ba-b74d-4b3c-a473-60980e6bc2a5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:14.746941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:14.747729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:14.747999 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:14.748263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] PATH_INFO: `/v3/projects/e241aae9188144a6b71a6c7c76a8665f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:14.749354 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e241aae9188144a6b71a6c7c76a8665f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:14.751262 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:14.824839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e241aae9188144a6b71a6c7c76a8665f', 'request_id': 'req-007ab4dd-39bc-4987-8793-cf67fb087eb4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.830991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e241aae9188144a6b71a6c7c76a8665f', 'request_id': 'req-007ab4dd-39bc-4987-8793-cf67fb087eb4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.839016 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e241aae9188144a6b71a6c7c76a8665f', 'request_id': 'req-007ab4dd-39bc-4987-8793-cf67fb087eb4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.850130 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] The token cache is being invalidate because project e241aae9188144a6b71a6c7c76a8665f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:14.850424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.851088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.852603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1327/2672] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:14 2022] DELETE /identity/v3/projects/e241aae9188144a6b71a6c7c76a8665f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:14.857036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:14.866971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ecd-a0e1-410b-b936-51e55cddf0f1 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:14.925706 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:14.926354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:14.926624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:14.926888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] PATH_INFO: `/v3/users/c5c71f33e6fb4284b4563558c5762b82` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:14.927988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c71f33e6fb4284b4563558c5762b82)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:14.929882 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:14.963233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:14.976843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c71f33e6fb4284b4563558c5762b82'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.983777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c71f33e6fb4284b4563558c5762b82'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:14.995717 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c71f33e6fb4284b4563558c5762b82'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.002562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c71f33e6fb4284b4563558c5762b82'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.003185 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-cab5d61b-7acc-46a7-881c-6e6bed487026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c71f33e6fb4284b4563558c5762b82'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.008999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1346/2673] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:14 2022] DELETE /identity/v3/users/c5c71f33e6fb4284b4563558c5762b82 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:15.289640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.291738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:15.306489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab4dd-39bc-4987-8793-cf67fb087eb4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.364510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.365142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.365419 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.365700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] PATH_INFO: `/v3/projects/faeefa4d71a24a75b9d1de51610f1c55` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.366836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeefa4d71a24a75b9d1de51610f1c55)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.368748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.393587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:15.418414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeefa4d71a24a75b9d1de51610f1c55', 'request_id': 'req-65237583-cf5b-4a5b-858b-65121a781402'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.424502 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeefa4d71a24a75b9d1de51610f1c55', 'request_id': 'req-65237583-cf5b-4a5b-858b-65121a781402'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.432103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeefa4d71a24a75b9d1de51610f1c55', 'request_id': 'req-65237583-cf5b-4a5b-858b-65121a781402'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.443455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] The token cache is being invalidate because project faeefa4d71a24a75b9d1de51610f1c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:15.443756 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.444370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65237583-cf5b-4a5b-858b-65121a781402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:15.445823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1328/2674] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:15 2022] DELETE /identity/v3/projects/faeefa4d71a24a75b9d1de51610f1c55 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:15.451308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.451802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.451920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.471222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:15.472406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:15.529806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1347/2675] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:15.537647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.537951 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.538225 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.557486 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:15.558716 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:15.566577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1329/2676] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:15.570772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.580739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655de9c-1954-4182-9751-196d60f98e49 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.585387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.586033 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.586367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.586640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.587293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:15.588347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.589972 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.601485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1348/2677] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:15.605602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.614798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca29a8c-c1aa-4291-9b01-187ffd117cca None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.619570 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.620155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.620457 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.620718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.621321 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.623211 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.651695 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1330/2678] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:15 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:15.655757 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.665505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a724db-1259-424a-a41a-73890d713bd3 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.723071 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.723656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.723927 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.724186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.724794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.726711 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.747201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1349/2679] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:15 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:15.751365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.762098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acce0e-6c33-403d-8210-0211bc32d7af admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.766585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.767173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.767445 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.767964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.768589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.770188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.779715 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1331/2680] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:15.783501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.793099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91533a-d33f-451c-93e7-b68b38806fc2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.797652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.798266 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.798542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.798806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.799424 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.800981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaf98c-643b-4426-9af2-1857913447e4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.812128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1350/2681] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:15.816043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.826550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10d4a1-01bb-4e2c-8650-9d0a9d813943 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:15.831141 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:15.831990 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.832272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.832544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] PATH_INFO: `/v3/projects/939a1643ef2d4adebaf53a474f09d3dc/users/d74b741510734ec6bc245109473f253f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.846889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939a1643ef2d4adebaf53a474f09d3dc, user_id=d74b741510734ec6bc245109473f253f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:15.849492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:15.862172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1332/2682] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:15 2022] PUT /identity/v3/projects/939a1643ef2d4adebaf53a474f09d3dc/users/d74b741510734ec6bc245109473f253f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:15.867051 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1672-8f54-4dd2-bc1d-468057dc691b None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:15.867322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1672-8f54-4dd2-bc1d-468057dc691b None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:15.867588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1672-8f54-4dd2-bc1d-468057dc691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:15.887541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-170d1672-8f54-4dd2-bc1d-468057dc691b None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:15.888653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-170d1672-8f54-4dd2-bc1d-468057dc691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:15.898800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:15.958216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1351/2683] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:15.967749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:15.969446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:16.027129 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1b8a-efde-4628-bdb8-d1dc92d73ee4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:16.030747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:16.031344 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.031615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.031881 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:16.041531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:16.042906 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:16.052621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1333/2684] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:16.689247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.689806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.689806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:16.718968 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] MFA Rules not processed for user `d74b741510734ec6bc245109473f253f`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:16.720161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:16.785765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1352/2685] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:16.790304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:16.799775 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b431-c92b-4cb0-bfce-b89cd893061c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:16.804376 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:16.805037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.805378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.805714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:16.806953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:16.808896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:16.840677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1334/2686] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:16.844958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:16.856161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331df3a-7669-47a9-9c40-016cc5d11454 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:16.918881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:16.919486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.919759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.920028 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:16.920651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:16.922601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:16.943055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1353/2687] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:16 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:16.947210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:16.957298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ab21e-3527-4644-8866-86429528cef7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:16.961718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:16.962341 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.962615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.962879 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:16.963501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:16.965070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:16.975513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1335/2688] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:16.979981 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:16.989760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db8962-e858-41de-8e91-88ceb8bf4a9c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:16.994930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:16.995554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:16.995828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:16.996095 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] PATH_INFO: `/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548/users/36c8e8c93e864093bce58bb915701480/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:17.010457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d2851a6f1144f1bbb1f1930ff75548, user_id=36c8e8c93e864093bce58bb915701480, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:17.013116 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:17.025632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1354/2689] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:16 2022] PUT /identity/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548/users/36c8e8c93e864093bce58bb915701480/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:17.029464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:17.039197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691438-2cd1-44fd-9de6-1c3d3bee1e9f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:17.051586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:17.098953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:17.099645 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:17.099987 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:17.100264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:17.100903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:17.103519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a9f4-7f53-4b6c-b8b8-c1f29a31e2a6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:17.113698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1336/2690] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:17.117871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:17.128858 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff28c-a714-4aa9-828a-1346cf380574 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:17.133467 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:17.134176 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:17.134460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:17.134733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] PATH_INFO: `/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548/users/36c8e8c93e864093bce58bb915701480/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:17.136694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d2851a6f1144f1bbb1f1930ff75548, user_id=36c8e8c93e864093bce58bb915701480, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:17.139367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:17.145327 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:17.152672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1355/2691] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:17 2022] PUT /identity/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548/users/36c8e8c93e864093bce58bb915701480/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:17.854009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:17.854584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:17.854584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:17.886373 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] MFA Rules not processed for user `36c8e8c93e864093bce58bb915701480`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:17.887605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:17.961735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1337/2692] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:17.968806 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:17.970644 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:18.028366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b6c1-c54b-47e0-b6ea-521b424e6b31 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:18.031870 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:18.032461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:18.032732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:18.032998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:18.087136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:18.088562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:18.097189 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1356/2693] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:22.593769 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:22.604049 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1aff1-0554-4947-ac08-5c7bb4470ae1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:22.607535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:22.608124 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:22.608398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:22.608665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:22.617462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:22.618941 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6952-91e7-4cef-ae72-73834c0827ee service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:22.628112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1338/2694] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:28.093267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=49 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:32.624074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=61 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:38.568800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:38.570279 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:38.633297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f0b7-e2d2-4eef-839a-3ea22d549231 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:38.638536 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:38.639158 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:38.639433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:38.639701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] PATH_INFO: `/v3/users/d564db143c7b4c49a0b8226b44918e00` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:38.640802 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d564db143c7b4c49a0b8226b44918e00)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:38.642772 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:38.688263 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd564db143c7b4c49a0b8226b44918e00'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:38.697037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd564db143c7b4c49a0b8226b44918e00'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:38.708795 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd564db143c7b4c49a0b8226b44918e00'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:38.716199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd564db143c7b4c49a0b8226b44918e00'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:38.716911 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd564db143c7b4c49a0b8226b44918e00'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:38.723074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1357/2695] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:38 2022] DELETE /identity/v3/users/d564db143c7b4c49a0b8226b44918e00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:38.727585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:38.728067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:38.728183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:38.746319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:38.747499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:38.804635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1339/2696] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:38.814136 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:38.815499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:38.870128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99dcca-5a5c-4832-9838-9e1019efcc64 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:38.873682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:38.874312 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:38.874585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:38.874848 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:38.883697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:38.885616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:38.895419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1358/2697] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:39.168718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:39.170195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:39.189865 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb3f5a-7b48-453b-95b7-8953fd419363 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:39.208441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:39.208441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:39.208441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:39.208441 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] PATH_INFO: `/v3/projects/b2377a03c1bd436581a3a3f67dec02f7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:39.209363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2377a03c1bd436581a3a3f67dec02f7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:39.209363 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:39.260528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2377a03c1bd436581a3a3f67dec02f7', 'request_id': 'req-10da5986-5d85-48de-aada-00b4c945689c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.271829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2377a03c1bd436581a3a3f67dec02f7', 'request_id': 'req-10da5986-5d85-48de-aada-00b4c945689c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.283498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2377a03c1bd436581a3a3f67dec02f7', 'request_id': 'req-10da5986-5d85-48de-aada-00b4c945689c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.294194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] The token cache is being invalidate because project b2377a03c1bd436581a3a3f67dec02f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:39.294480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.295088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.296552 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1340/2698] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:39 2022] DELETE /identity/v3/projects/b2377a03c1bd436581a3a3f67dec02f7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:39.300528 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:39.310611 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fd73-bc6a-482a-baff-867a3c30f627 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:39.329557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:39.368072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:39.369315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:39.369586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:39.369851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] PATH_INFO: `/v3/users/638d69a9c0624aecb221f62bb0f67a97` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:39.370989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638d69a9c0624aecb221f62bb0f67a97)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:39.372877 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:39.421391 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638d69a9c0624aecb221f62bb0f67a97'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.428011 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638d69a9c0624aecb221f62bb0f67a97'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.440567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638d69a9c0624aecb221f62bb0f67a97'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.447570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638d69a9c0624aecb221f62bb0f67a97'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.448233 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45219339-d4d2-4b3f-b563-f72fdd8ba1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638d69a9c0624aecb221f62bb0f67a97'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.454077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1359/2699] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:39 2022] DELETE /identity/v3/users/638d69a9c0624aecb221f62bb0f67a97 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:39.724175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:39.725677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:39.739188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da5986-5d85-48de-aada-00b4c945689c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:39.796386 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:39.797010 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:39.797287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:39.797554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] PATH_INFO: `/v3/projects/ff9b4d99db094430bd3c89a7f29e661b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:39.798692 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9b4d99db094430bd3c89a7f29e661b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:39.800579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:39.829940 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:39.847839 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9b4d99db094430bd3c89a7f29e661b', 'request_id': 'req-bed3cf8b-a59f-40be-beb1-1e263452aa29'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.854328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9b4d99db094430bd3c89a7f29e661b', 'request_id': 'req-bed3cf8b-a59f-40be-beb1-1e263452aa29'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.861395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9b4d99db094430bd3c89a7f29e661b', 'request_id': 'req-bed3cf8b-a59f-40be-beb1-1e263452aa29'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.871395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] The token cache is being invalidate because project ff9b4d99db094430bd3c89a7f29e661b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:39.871676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.872287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bed3cf8b-a59f-40be-beb1-1e263452aa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:39.873771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1341/2700] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:39 2022] DELETE /identity/v3/projects/ff9b4d99db094430bd3c89a7f29e661b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:39.878875 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:39.879376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:39.879376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:39.899137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:39.900799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:39.959941 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1360/2701] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:39.968623 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:39.968905 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:39.969172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:39.989544 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:39.990767 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:39.999055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1342/2702] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:40.004570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.015069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c0ae-8404-4d2c-9f90-fd94e5058718 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.019949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.020541 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.020815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.021082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.021753 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:40.022090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.023675 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.035100 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1361/2703] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:40.039471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.048537 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93422e5a-15e6-4d54-884f-c3019db5795a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.053108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.053702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.054005 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.054276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.054901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.057261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.083546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1343/2704] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:40.087542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.097264 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4812f-e3f0-4c14-bab4-3422840c6b76 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.123514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:40.155469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.156061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.156336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.156602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.157212 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.159132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.180131 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1362/2705] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:40.184750 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.194678 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064f74f-6b80-48c4-ae4f-0c90133e3fe6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.199173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.199757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.200017 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.200280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.200898 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.202497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.213036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1344/2706] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:40.216604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.228545 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4332-2832-42c2-8b51-a4d0d3cf90a9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.233508 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.234162 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.234469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.234698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.235367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.236951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637091-5f8a-4c85-be44-585d65daa5b0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.250893 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1363/2707] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:40.252027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.264664 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce49d1d-4f90-482a-b893-56fa2a7866dd admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.269554 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.270259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.270530 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.270791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] PATH_INFO: `/v3/projects/1c573ea68d0e435cb0346589bdaeafd8/users/1ccf5cf6219e47b28d355c6b0c6c4af0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.285473 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c573ea68d0e435cb0346589bdaeafd8, user_id=1ccf5cf6219e47b28d355c6b0c6c4af0, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.288126 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.301816 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1345/2708] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:40 2022] PUT /identity/v3/projects/1c573ea68d0e435cb0346589bdaeafd8/users/1ccf5cf6219e47b28d355c6b0c6c4af0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:40.313311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.313692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.314022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.342058 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] MFA Rules not processed for user `1ccf5cf6219e47b28d355c6b0c6c4af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:40.343340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:40.409243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1364/2709] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:40.413616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.481604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99def368-a6aa-4bec-91d8-0614ecece6ca admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.500114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.500114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.500114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.500114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.501197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.501197 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.526811 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1346/2710] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:40.531091 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.543223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace45d7-b5c8-46d7-9c5d-4e4b6d5e9bcd None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.600747 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.601353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.601632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.601920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.602558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.605066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.628354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1365/2711] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:40.632297 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.645528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb465b0-472e-4746-b8c1-3f550ef5b0c2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.650687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.651292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.651566 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.651831 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.652471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.654127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.665847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1347/2712] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:40.670425 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.681637 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335904-f845-4e60-ad3b-0e1423a76f4c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.686248 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.686892 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.687163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.687428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] PATH_INFO: `/v3/projects/abafa666052549bd8fae6ecfdfa2ff83/users/3d9ffa2652324cfbbee91688be129216/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.706303 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abafa666052549bd8fae6ecfdfa2ff83, user_id=3d9ffa2652324cfbbee91688be129216, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.709171 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.723270 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1366/2713] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:40 2022] PUT /identity/v3/projects/abafa666052549bd8fae6ecfdfa2ff83/users/3d9ffa2652324cfbbee91688be129216/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:40.727343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.738112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e18ce0-811f-4046-a1ba-560d90f32872 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.758516 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:40.801109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.801936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.802545 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.805724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.806430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.808032 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea762a0-0304-4651-aafb-fda2fde33228 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.818724 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1348/2714] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:40.822891 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.828787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:40.836056 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ef850-69f1-4a9d-9d55-343e8802dcd8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:40.841754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:40.842544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.842815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.843243 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] PATH_INFO: `/v3/projects/abafa666052549bd8fae6ecfdfa2ff83/users/3d9ffa2652324cfbbee91688be129216/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.845132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=abafa666052549bd8fae6ecfdfa2ff83, user_id=3d9ffa2652324cfbbee91688be129216, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:40.847797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:40.858499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1367/2715] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:40 2022] PUT /identity/v3/projects/abafa666052549bd8fae6ecfdfa2ff83/users/3d9ffa2652324cfbbee91688be129216/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:40.868693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:40.868980 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:40.869249 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:40.896802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] MFA Rules not processed for user `3d9ffa2652324cfbbee91688be129216`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:40.897975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:40.964329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1349/2716] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:40.975629 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:40.977396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:41.036537 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1cc2-9d21-46e3-a642-9c2a1a6fc6bf admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:41.040597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:41.041188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.041457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.041720 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.050502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:41.051904 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060dc99-6675-423f-8288-c222c9c598ec service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:41.061850 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1368/2717] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:41.128531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:41.195985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d9ad-af73-4db3-956d-99c888719669 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:41.201214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:41.201872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.202183 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.202446 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] PATH_INFO: `/v3/users/1ccf5cf6219e47b28d355c6b0c6c4af0` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.203737 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccf5cf6219e47b28d355c6b0c6c4af0)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:41.205677 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:41.258037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccf5cf6219e47b28d355c6b0c6c4af0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.260401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:41.266721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccf5cf6219e47b28d355c6b0c6c4af0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.279396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccf5cf6219e47b28d355c6b0c6c4af0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.280020 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccf5cf6219e47b28d355c6b0c6c4af0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.280622 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccf5cf6219e47b28d355c6b0c6c4af0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.293282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1350/2718] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:41 2022] DELETE /identity/v3/users/1ccf5cf6219e47b28d355c6b0c6c4af0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:41.297871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.298179 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.298447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.317197 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:41.318399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:41.375554 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1369/2719] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:41.386498 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:41.388882 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:41.446144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849bb1-2f11-4a9a-99ce-4227f990d3db admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:41.450305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:41.450900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.451182 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.451449 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.460305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:41.461721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:41.471231 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1351/2720] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:41.738333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:41.739742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:41.752088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559265b-1df4-433c-ab75-4b855183e601 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:41.756657 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:41.757280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.757557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.757822 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] PATH_INFO: `/v3/projects/1c573ea68d0e435cb0346589bdaeafd8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.758969 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c573ea68d0e435cb0346589bdaeafd8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:41.760846 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:41.807294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c573ea68d0e435cb0346589bdaeafd8', 'request_id': 'req-c63ad79c-c56b-4524-8783-7b02573d5d5a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.814203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c573ea68d0e435cb0346589bdaeafd8', 'request_id': 'req-c63ad79c-c56b-4524-8783-7b02573d5d5a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.820249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c573ea68d0e435cb0346589bdaeafd8', 'request_id': 'req-c63ad79c-c56b-4524-8783-7b02573d5d5a'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.830389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] The token cache is being invalidate because project 1c573ea68d0e435cb0346589bdaeafd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:41.830671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.831290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.832728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1370/2721] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:41 2022] DELETE /identity/v3/projects/1c573ea68d0e435cb0346589bdaeafd8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:41.836859 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:41.846351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495cd3-10cd-4c57-a1d2-ad6737213146 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:41.911317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:41.911944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:41.912221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:41.912504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] PATH_INFO: `/v3/users/3d9ffa2652324cfbbee91688be129216` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:41.913589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9ffa2652324cfbbee91688be129216)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:41.916068 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:41.966394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9ffa2652324cfbbee91688be129216'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.978267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9ffa2652324cfbbee91688be129216'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.990043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:41.991395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9ffa2652324cfbbee91688be129216'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.992206 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9ffa2652324cfbbee91688be129216'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:41.992972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1b83bb95-a939-40d2-95ad-a38f3fa8d859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9ffa2652324cfbbee91688be129216'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.006691 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1352/2722] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:41 2022] DELETE /identity/v3/users/3d9ffa2652324cfbbee91688be129216 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:42.294884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.296785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:42.310307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ad79c-c56b-4524-8783-7b02573d5d5a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.329983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:42.380294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.381000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.381340 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.381609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] PATH_INFO: `/v3/projects/abafa666052549bd8fae6ecfdfa2ff83` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.382756 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abafa666052549bd8fae6ecfdfa2ff83)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.385216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.433333 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abafa666052549bd8fae6ecfdfa2ff83', 'request_id': 'req-90e1ac7d-5803-4068-95f5-7adcab59ce03'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.442410 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abafa666052549bd8fae6ecfdfa2ff83', 'request_id': 'req-90e1ac7d-5803-4068-95f5-7adcab59ce03'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.449650 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abafa666052549bd8fae6ecfdfa2ff83', 'request_id': 'req-90e1ac7d-5803-4068-95f5-7adcab59ce03'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.460204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] The token cache is being invalidate because project abafa666052549bd8fae6ecfdfa2ff83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:42.460496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.461135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-90e1ac7d-5803-4068-95f5-7adcab59ce03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:42.463437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1371/2723] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:42 2022] DELETE /identity/v3/projects/abafa666052549bd8fae6ecfdfa2ff83 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:42.468002 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.468287 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.468556 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.488463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:42.489763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:42.552173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1353/2724] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:42.560748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.561034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.561304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.581937 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:42.583229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:42.591859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1372/2725] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:42.596290 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.605998 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336c1d-f0d0-4abc-85d7-e54be39d6379 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.610652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.611245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.611515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.611780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.612412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:42.612706 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.614323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.626372 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1354/2726] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:42.631004 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.641192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a00d-4e7d-4252-864d-95d0de88d17e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.646285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.646883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.647156 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.647420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.648027 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.650568 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.677204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1373/2727] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:42 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:42.681781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.692227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dff3d-dfd6-425f-a8c9-bcf97802eebb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.754307 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.754946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.755223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.755489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.756107 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.758030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.782320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1355/2728] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:42 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:42.783506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.793888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82f01-0e9f-4629-a4ed-a621ac6be091 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.798602 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.799307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.799682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.800047 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.800789 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.802570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.813509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1374/2729] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:42.817858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.829001 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105e51a-49d6-44ea-b750-020c74d83d46 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.833807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.834428 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.834703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.834972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.835602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.837219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c18293-63a2-483c-949f-2d85053a7897 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.851210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1356/2730] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:42.852571 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:42.862872 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f37e5-f3e2-4cc3-b8b7-bdf336c54f25 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:42.867384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:42.868021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.868780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.869045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] PATH_INFO: `/v3/projects/45bd61ba5de24ff6bf1a93afd9db84a0/users/a61c416025ba4ad798f28eb510adb28e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.884624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bd61ba5de24ff6bf1a93afd9db84a0, user_id=a61c416025ba4ad798f28eb510adb28e, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:42.887328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:42.901109 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1375/2731] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:42 2022] PUT /identity/v3/projects/45bd61ba5de24ff6bf1a93afd9db84a0/users/a61c416025ba4ad798f28eb510adb28e/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:42.911649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:42.912026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:42.912364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:42.940688 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] MFA Rules not processed for user `a61c416025ba4ad798f28eb510adb28e`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:42.941878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:42.989559 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.012943 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1357/2732] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:43.017012 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.024151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.026208 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.076591 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.096761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fb8b-30a0-4974-859c-aec7b156bf2c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.098047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf2306-e523-42d1-985d-74794d25a2c3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.101593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.102260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.103192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.103486 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.104107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.105790 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.106072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.106577 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.106926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.107265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] PATH_INFO: `/v3/users/d74b741510734ec6bc245109473f253f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.108482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74b741510734ec6bc245109473f253f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.110488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.135334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1376/2733] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:43 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:43.139532 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.162829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74b741510734ec6bc245109473f253f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.170761 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74b741510734ec6bc245109473f253f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.184539 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74b741510734ec6bc245109473f253f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.185210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74b741510734ec6bc245109473f253f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.186144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74b741510734ec6bc245109473f253f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.199219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1358/2734] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:43 2022] DELETE /identity/v3/users/d74b741510734ec6bc245109473f253f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:43.205090 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544345-ffc2-4436-8930-7c22de358eeb admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.263394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.264006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.264311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.264579 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.265201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.267151 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.293045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1377/2735] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:43 2022] POST /identity/v3/users => generated 306 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:43.294384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.295796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.308874 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baf39b-128f-4ce8-ad37-4e72e8e690bb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.313520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.314153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.314432 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.314701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.315340 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.316928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.327808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1359/2736] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:43.332274 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.342785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34f1d-5818-477c-861a-108bdc2c8268 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.347402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.348172 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.348498 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.348770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] PATH_INFO: `/v3/projects/01f8f544f5114603bcf22919d19d4ad1/users/91e010a978c24309a16132fde17d3fb1/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.365045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f8f544f5114603bcf22919d19d4ad1, user_id=91e010a978c24309a16132fde17d3fb1, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.368034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.379413 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.382450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.389817 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1378/2737] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:43 2022] PUT /identity/v3/projects/01f8f544f5114603bcf22919d19d4ad1/users/91e010a978c24309a16132fde17d3fb1/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:43.395826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.404709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a737-bb93-49ae-a0a1-d79d88b593d7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.447093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.457487 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.468631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593f93b-8306-488f-a3ba-1fdc28f4446a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.471055 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.471713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.471994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.472267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] PATH_INFO: `/v3/projects/939a1643ef2d4adebaf53a474f09d3dc` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.473407 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939a1643ef2d4adebaf53a474f09d3dc)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.473998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.474695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.475067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.475328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.475437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.476083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.477690 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.487594 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1379/2738] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:43.491746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.502250 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377b56f-afeb-42e9-a031-c1a897f7dd1a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.507514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.508492 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.509431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.509804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] PATH_INFO: `/v3/projects/01f8f544f5114603bcf22919d19d4ad1/users/91e010a978c24309a16132fde17d3fb1/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.511902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f8f544f5114603bcf22919d19d4ad1, user_id=91e010a978c24309a16132fde17d3fb1, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.514651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db6eb-4fab-4257-a972-e15757e77549 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.526703 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1380/2739] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:43 2022] PUT /identity/v3/projects/01f8f544f5114603bcf22919d19d4ad1/users/91e010a978c24309a16132fde17d3fb1/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:43.527580 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939a1643ef2d4adebaf53a474f09d3dc', 'request_id': 'req-c67e05dc-5bb6-455d-bf23-b1605e1884c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.534610 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939a1643ef2d4adebaf53a474f09d3dc', 'request_id': 'req-c67e05dc-5bb6-455d-bf23-b1605e1884c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.537733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.538043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.538625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.542393 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939a1643ef2d4adebaf53a474f09d3dc', 'request_id': 'req-c67e05dc-5bb6-455d-bf23-b1605e1884c7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.553047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] The token cache is being invalidate because project 939a1643ef2d4adebaf53a474f09d3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:43.553440 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.554227 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.556454 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1360/2740] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:43 2022] DELETE /identity/v3/projects/939a1643ef2d4adebaf53a474f09d3dc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:43.560257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.561630 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.568414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] MFA Rules not processed for user `91e010a978c24309a16132fde17d3fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:43.569578 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.626542 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e05dc-5bb6-455d-bf23-b1605e1884c7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.637544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1381/2741] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:43.648535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.649997 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.685624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.686379 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.686654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.687046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] PATH_INFO: `/v3/users/36c8e8c93e864093bce58bb915701480` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.688377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c8e8c93e864093bce58bb915701480)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.690421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.715949 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3152-229e-4c10-b54b-4e631bacce8e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.720163 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981127-1330-4871-9427-a45929bee766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.720919 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981127-1330-4871-9427-a45929bee766 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.721146 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981127-1330-4871-9427-a45929bee766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.721414 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981127-1330-4871-9427-a45929bee766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.727685 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.731742 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62981127-1330-4871-9427-a45929bee766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.733359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62981127-1330-4871-9427-a45929bee766 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.743803 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1382/2742] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:32:43.744086 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c8e8c93e864093bce58bb915701480'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.751802 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c8e8c93e864093bce58bb915701480'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.765011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c8e8c93e864093bce58bb915701480'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.766564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c8e8c93e864093bce58bb915701480'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.767832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c8e8c93e864093bce58bb915701480'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:43.782377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1361/2743] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:43 2022] DELETE /identity/v3/users/36c8e8c93e864093bce58bb915701480 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:43.819262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981127-1330-4871-9427-a45929bee766 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.829055 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981127-1330-4871-9427-a45929bee766 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:43.886127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:43.886487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:43.886758 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:43.887022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:43.888865 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.894299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:43.956000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:43.957461 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6b64f-a174-4e86-a9ad-2576da33b447 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:43.961083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:43.962564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:43.968111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1383/2744] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:44.037034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7b97-73b4-4878-94c6-d3f434333017 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.042346 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.042970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.043246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.043513 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] PATH_INFO: `/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.044618 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d2851a6f1144f1bbb1f1930ff75548)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.046603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.094087 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d2851a6f1144f1bbb1f1930ff75548', 'request_id': 'req-48bb0181-5148-41e0-9e93-69381415af1a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:44.100226 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d2851a6f1144f1bbb1f1930ff75548', 'request_id': 'req-48bb0181-5148-41e0-9e93-69381415af1a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:44.107563 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d2851a6f1144f1bbb1f1930ff75548', 'request_id': 'req-48bb0181-5148-41e0-9e93-69381415af1a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:44.119829 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] The token cache is being invalidate because project b8d2851a6f1144f1bbb1f1930ff75548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:44.120132 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:44.120919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-48bb0181-5148-41e0-9e93-69381415af1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:44.122575 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1362/2745] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:43 2022] DELETE /identity/v3/projects/b8d2851a6f1144f1bbb1f1930ff75548 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:44.127979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.128261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.128617 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.149360 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:44.150557 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:44.221286 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1384/2746] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:32:44.230586 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.230981 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.231312 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.253593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:44.254955 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:44.273597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1363/2747] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:44.278453 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.291561 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f25827-1c7f-48ba-868f-17d67dc85b15 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.297236 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.298322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.298781 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.299328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.300133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:44.300432 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.302083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.314607 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1385/2748] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:44.319160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.328380 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc258fa-3376-4813-917d-d92aa22c4adf None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.333294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.333911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.334186 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.334455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.335093 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.337490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.364364 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1364/2749] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:44.368535 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.378344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581532bc-f42c-45f0-b0d6-40f7f6e14edc admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.435381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.435902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.436177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.436443 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.437062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.439021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.459477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1386/2750] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:44.464029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.474222 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07040a-4b63-4327-8960-1bc452232a0f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.479398 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.479986 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.480263 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.480531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.481162 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.482799 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.484827 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:44.494072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1365/2751] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:44.499022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.509766 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137274d-7c5c-4367-972f-dbe047f478f2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.514464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.515043 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.515316 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.515585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.516221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.517797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb782a-92dc-4c1f-88b8-f2beee832487 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.528839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1387/2752] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:44.532928 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.543417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb5765-9b35-4b60-8fca-a808cc2b5a78 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.547900 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.548536 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.548807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.549072 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] PATH_INFO: `/v3/projects/bc6001f6c3c74eeeb831a643637a4fb5/users/0c3a744195ae47f59d14e1c8dfe3cb24/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.562985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6001f6c3c74eeeb831a643637a4fb5, user_id=0c3a744195ae47f59d14e1c8dfe3cb24, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.565578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.578027 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1366/2753] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:44 2022] PUT /identity/v3/projects/bc6001f6c3c74eeeb831a643637a4fb5/users/0c3a744195ae47f59d14e1c8dfe3cb24/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:44.590945 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.591228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.591499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.614827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:44.622970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] MFA Rules not processed for user `0c3a744195ae47f59d14e1c8dfe3cb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:44.624415 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:44.689474 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1388/2754] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:44.694683 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.755218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e9716-79f5-4442-a50e-da1202115d73 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.759806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.760397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.760671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.760939 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.761553 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.763450 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.792540 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1367/2755] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:44.794979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.805426 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a0170-80fc-4c50-ab5e-909d286cf97f None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.860208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.860828 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.861107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.861376 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.862024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.863934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.886991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1389/2756] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:44 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:44.891196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.901800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585898d-15c0-4ef6-bbc4-5632357da3a5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.906587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.907194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.907468 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.907738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.908397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.910018 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.921315 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1368/2757] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:44.925351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.935920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00520-8ad1-4092-8aab-42793975659c admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.940974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.941501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.941770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.942061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.942701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.944306 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e085a9d-2e59-4110-ab19-0b8b387df5a1 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:44.954363 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1390/2758] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:44.958642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:44.969033 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e9b4d-958f-4e21-a68c-528b6bfe1ddc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:44.973597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:44.974256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:44.974533 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:44.974805 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] PATH_INFO: `/v3/projects/3586c4f2956f4536b730c7452c01a808/users/3adf7026a6f84895b85d2dfb9662c173/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:44.991000 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3586c4f2956f4536b730c7452c01a808, user_id=3adf7026a6f84895b85d2dfb9662c173, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:44.993615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.006158 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1369/2759] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:44 2022] PUT /identity/v3/projects/3586c4f2956f4536b730c7452c01a808/users/3adf7026a6f84895b85d2dfb9662c173/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:45.016368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.016681 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.016953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.046380 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] MFA Rules not processed for user `3adf7026a6f84895b85d2dfb9662c173`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:45.047581 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:45.110217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1391/2760] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:45.114788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.175475 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425947-269d-4bd9-bb9c-d6f1a66dbc58 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.180090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.180684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.180960 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.181229 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.181835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.183733 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.209156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1370/2761] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:45 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:45.217262 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.229408 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b9a14-b2ef-4bff-a051-694daf0a2883 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.234649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:45.288963 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.289558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.289831 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.290127 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.290769 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.292698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.316856 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1392/2762] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:45 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:45.324164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.334654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70081-c169-4181-b9e7-d8dc3bf17bc4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.339325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.339919 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.340195 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.340463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.341122 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.342740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.344878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:45.359642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1371/2763] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:45.360800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.371632 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae78e4-166d-4ad8-890b-85ce26bca1f5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.376718 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.377430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.377713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.378132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] PATH_INFO: `/v3/projects/38ae110fc3054e07a161122437da35b3/users/77a27bba4f994488a862c769c16d0572/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.396444 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ae110fc3054e07a161122437da35b3, user_id=77a27bba4f994488a862c769c16d0572, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.399165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.413077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1393/2764] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:45 2022] PUT /identity/v3/projects/38ae110fc3054e07a161122437da35b3/users/77a27bba4f994488a862c769c16d0572/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:45.417834 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.427836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a3c4-0edb-40b2-8e3b-400b7f3540aa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.486686 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.487293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.487576 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.487848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.488512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.490151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9159-46b5-4cef-be68-4fccec666051 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.501274 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1372/2765] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:45.505544 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.516608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600ec-a5b4-4c27-8744-b0bf68dacd00 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.524129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.525087 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.525478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.525752 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] PATH_INFO: `/v3/projects/38ae110fc3054e07a161122437da35b3/users/77a27bba4f994488a862c769c16d0572/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.527843 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ae110fc3054e07a161122437da35b3, user_id=77a27bba4f994488a862c769c16d0572, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.530547 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.544447 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1394/2766] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:45 2022] PUT /identity/v3/projects/38ae110fc3054e07a161122437da35b3/users/77a27bba4f994488a862c769c16d0572/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:45.558152 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775515d5-2268-4286-96a1-61534752dc63 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.558531 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775515d5-2268-4286-96a1-61534752dc63 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.558877 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775515d5-2268-4286-96a1-61534752dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.590857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-775515d5-2268-4286-96a1-61534752dc63 None None] MFA Rules not processed for user `77a27bba4f994488a862c769c16d0572`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:45.592048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-775515d5-2268-4286-96a1-61534752dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:45.666080 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1373/2767] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:45.677845 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:45.679771 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:45.742311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a343-9c18-4c0b-aa7a-26158401090f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:45.748130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:45.749160 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:45.749648 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:45.750170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:45.806659 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:45.808089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:45.816760 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1395/2768] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:47.308421 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775515d5-2268-4286-96a1-61534752dc63 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:47.317948 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775515d5-2268-4286-96a1-61534752dc63 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:47.321411 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:47.322046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:47.322320 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:47.322585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:47.378253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:47.379579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:47.389133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1374/2769] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:47.915353 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:47.924741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a50b9b-23ea-482a-badc-3060e54464f4 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:47.930522 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:47.931558 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:47.932048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:47.932506 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:47.943194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:47.944839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fb163-858c-4bf4-b14d-fe28c9abf390 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:47.956497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1396/2770] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:48.045936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:48.047773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:48.070261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:48.115384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa0aab-d892-4d16-8d37-9a72afa340aa service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:48.119843 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:48.120461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:48.120728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:48.120992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] PATH_INFO: `/v3/users/a61c416025ba4ad798f28eb510adb28e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:48.122150 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61c416025ba4ad798f28eb510adb28e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:48.124042 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:48.169524 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61c416025ba4ad798f28eb510adb28e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.176726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61c416025ba4ad798f28eb510adb28e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.188585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61c416025ba4ad798f28eb510adb28e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.189214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61c416025ba4ad798f28eb510adb28e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.189810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61c416025ba4ad798f28eb510adb28e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.201778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1375/2771] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:48 2022] DELETE /identity/v3/users/a61c416025ba4ad798f28eb510adb28e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:48.206348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:48.206630 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:48.206902 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:48.214337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:48.227135 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:48.228935 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:48.288608 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1397/2772] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:48.299350 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:48.300729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:48.360974 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581439b7-b4b6-4074-bf9b-fc0505c2cf4a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:48.365156 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:48.365778 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:48.366207 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:48.366527 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:48.375482 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:48.376890 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:48.386605 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1376/2773] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:48.650107 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:48.652193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:48.664060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6588-5ef5-4eb4-8722-04be8f146e41 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:48.668770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:48.669399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:48.669677 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:48.669974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] PATH_INFO: `/v3/projects/45bd61ba5de24ff6bf1a93afd9db84a0` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:48.671119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bd61ba5de24ff6bf1a93afd9db84a0)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:48.673029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:48.720725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bd61ba5de24ff6bf1a93afd9db84a0', 'request_id': 'req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.728229 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bd61ba5de24ff6bf1a93afd9db84a0', 'request_id': 'req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.735193 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bd61ba5de24ff6bf1a93afd9db84a0', 'request_id': 'req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.745776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] The token cache is being invalidate because project 45bd61ba5de24ff6bf1a93afd9db84a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:48.746576 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.747201 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.748656 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1398/2774] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:48 2022] DELETE /identity/v3/projects/45bd61ba5de24ff6bf1a93afd9db84a0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:48.752621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:48.762991 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff814-34d7-442c-bbd5-076fb1a60d66 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:48.799704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:48.819807 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:48.820424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:48.820702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:48.820971 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] PATH_INFO: `/v3/users/91e010a978c24309a16132fde17d3fb1` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:48.822727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e010a978c24309a16132fde17d3fb1)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:48.824616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:48.869663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e010a978c24309a16132fde17d3fb1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.877375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e010a978c24309a16132fde17d3fb1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.890420 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e010a978c24309a16132fde17d3fb1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.891112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e010a978c24309a16132fde17d3fb1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.891703 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-21994451-b147-4a65-85ac-998a5a8bc7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e010a978c24309a16132fde17d3fb1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:48.903739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1377/2775] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:48 2022] DELETE /identity/v3/users/91e010a978c24309a16132fde17d3fb1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:49.169199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.173018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:49.187275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573549-8ce3-462d-87b3-2a9ea4b1d8d9 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.246867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.247874 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.248159 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.248464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] PATH_INFO: `/v3/projects/01f8f544f5114603bcf22919d19d4ad1` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.249664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f8f544f5114603bcf22919d19d4ad1)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.251695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.285379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:49.306748 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f8f544f5114603bcf22919d19d4ad1', 'request_id': 'req-55757689-88d2-4fca-ba45-e61158c2ae04'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:49.314712 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f8f544f5114603bcf22919d19d4ad1', 'request_id': 'req-55757689-88d2-4fca-ba45-e61158c2ae04'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:49.321505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f8f544f5114603bcf22919d19d4ad1', 'request_id': 'req-55757689-88d2-4fca-ba45-e61158c2ae04'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:49.347291 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] The token cache is being invalidate because project 01f8f544f5114603bcf22919d19d4ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:49.347645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:49.348298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-55757689-88d2-4fca-ba45-e61158c2ae04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:49.354643 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1399/2776] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:49 2022] DELETE /identity/v3/projects/01f8f544f5114603bcf22919d19d4ad1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:49.354992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.355349 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.355696 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.378503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:49.379835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:49.452099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1378/2777] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:49.459880 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.460165 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.460431 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.480704 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:49.481943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:49.489710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1400/2778] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:49.493814 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.504062 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e425c-fad9-4421-aa6d-bc0f76e71a3e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.508735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.509325 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.510256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.510532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.511282 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:49.511589 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.513176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.524873 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1379/2779] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:49.529084 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.538225 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d983-9765-4b37-a7fd-ab6100a98f9c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.542881 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.543565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.543914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.544183 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.544823 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.546732 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.573804 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1401/2780] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:49.577803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.587679 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce9785-9e27-48c3-b628-f13afb6612c1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.631723 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:49.646914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.647515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.647789 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.648057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.648675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.650587 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.670091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1380/2781] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:49.674198 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.684934 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7642-d7d6-40d9-935c-b8b604d66eb5 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.689477 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.690111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.690387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.690655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.691319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.693392 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.705253 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1402/2782] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:49.709066 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.718949 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625a10-c292-4c10-8046-6d915cf5864e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.723714 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.724298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.724578 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.724850 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.725483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.727084 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304823-8107-4deb-b6e0-0857b6fab667 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.737515 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1381/2783] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:49.741849 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.752096 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2bec4-3bc7-49c9-b38d-e879f35718b2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.756733 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.757308 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.757587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.757859 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] PATH_INFO: `/v3/projects/70c1f5197bd249fb9f2e1f618582c361/users/65f412c0990e40848ac6d9d5ea9cacb0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.772820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c1f5197bd249fb9f2e1f618582c361, user_id=65f412c0990e40848ac6d9d5ea9cacb0, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.775538 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.788129 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1403/2784] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:49 2022] PUT /identity/v3/projects/70c1f5197bd249fb9f2e1f618582c361/users/65f412c0990e40848ac6d9d5ea9cacb0/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:49.798289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.798573 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.798847 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.826497 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] MFA Rules not processed for user `65f412c0990e40848ac6d9d5ea9cacb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:49.827710 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:49.891098 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1382/2785] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:49.895134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:49.954958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264952-e96e-42cb-b2a3-6370dcc58266 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:49.959668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:49.960256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:49.960531 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:49.960800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:49.961417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:49.963367 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:49.989930 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1404/2786] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:49.994030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.005159 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f194f8-beb8-400a-8dc5-7dd16de96497 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.060483 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.061011 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.061289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.061561 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.062223 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.064175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.084216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1383/2787] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:49 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:50.088347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.098406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f651-3465-4174-871c-71937ccdc4da admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.102890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.103954 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.104227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.104490 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.105145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.106746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.117794 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1405/2788] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:50.122606 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.134351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19c06a-8a95-43da-8c06-0c928337987a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.139415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.140050 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.140329 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.140595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] PATH_INFO: `/v3/projects/d221f7b52d5947b1b95d87470168fdb8/users/5b44b8927ad24dbcbe2bc2c68e815893/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.155123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221f7b52d5947b1b95d87470168fdb8, user_id=5b44b8927ad24dbcbe2bc2c68e815893, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.157726 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.170846 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1384/2789] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:50 2022] PUT /identity/v3/projects/d221f7b52d5947b1b95d87470168fdb8/users/5b44b8927ad24dbcbe2bc2c68e815893/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:50.174731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.185389 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404f3b-1cf0-41ae-806c-c571db0f9969 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.208510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:50.245280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.245887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.246208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.246452 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.247099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.248708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922ef25-8b4a-42c3-b6ba-fa19718e56e2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.258691 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1406/2790] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:50.262944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.273194 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e685c2-b6d6-47c0-9a9b-a6614e988e37 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.278237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.278870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.279143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.279410 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] PATH_INFO: `/v3/projects/d221f7b52d5947b1b95d87470168fdb8/users/5b44b8927ad24dbcbe2bc2c68e815893/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.281317 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221f7b52d5947b1b95d87470168fdb8, user_id=5b44b8927ad24dbcbe2bc2c68e815893, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.283953 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.294608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1385/2791] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:50 2022] PUT /identity/v3/projects/d221f7b52d5947b1b95d87470168fdb8/users/5b44b8927ad24dbcbe2bc2c68e815893/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:50.359067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.359446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.359745 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.386777 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] MFA Rules not processed for user `5b44b8927ad24dbcbe2bc2c68e815893`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:50.387967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:50.457988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1407/2792] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:50.469213 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.471585 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:50.485044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:50.539036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9535-63c7-48fd-9aab-c8a9b1605f1e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.543915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.544836 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.545257 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.545653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.559401 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.561863 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042ad8a-4f2d-4d23-aafd-7fd1c0243f14 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.573247 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1386/2793] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:50.715635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:50.782851 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70af42-9b54-4d8f-9658-838225a83bf2 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:50.787364 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:50.788001 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.788273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.788542 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] PATH_INFO: `/v3/users/65f412c0990e40848ac6d9d5ea9cacb0` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.789654 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f412c0990e40848ac6d9d5ea9cacb0)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:50.791636 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:50.845667 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f412c0990e40848ac6d9d5ea9cacb0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:50.848705 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:50.855076 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f412c0990e40848ac6d9d5ea9cacb0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:50.869083 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f412c0990e40848ac6d9d5ea9cacb0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:50.876468 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f412c0990e40848ac6d9d5ea9cacb0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:50.877230 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f412c0990e40848ac6d9d5ea9cacb0'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:50.883824 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1408/2794] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:50 2022] DELETE /identity/v3/users/65f412c0990e40848ac6d9d5ea9cacb0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:50.888871 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:50.889143 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:50.889406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:50.911496 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:50.913031 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:50.990188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1387/2795] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:51.007044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:51.011196 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:51.071797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a873e1-6950-418c-ba9f-006f24701e38 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:51.076066 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:51.076665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:51.076936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:51.077199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:51.086223 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:51.087645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:51.096827 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1409/2796] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:51.371771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:51.373209 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:51.384935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fac8c-9a3c-4207-8aa6-7f391c8f7ac4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:51.389788 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:51.390522 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:51.390895 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:51.391163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] PATH_INFO: `/v3/projects/70c1f5197bd249fb9f2e1f618582c361` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:51.392406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c1f5197bd249fb9f2e1f618582c361)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:51.394602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:51.442348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c1f5197bd249fb9f2e1f618582c361', 'request_id': 'req-0c07677d-7441-4481-a684-e3c8bc6b6d0e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.448443 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c1f5197bd249fb9f2e1f618582c361', 'request_id': 'req-0c07677d-7441-4481-a684-e3c8bc6b6d0e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.455809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c1f5197bd249fb9f2e1f618582c361', 'request_id': 'req-0c07677d-7441-4481-a684-e3c8bc6b6d0e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.466217 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] The token cache is being invalidate because project 70c1f5197bd249fb9f2e1f618582c361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:51.466518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.467128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.468603 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1388/2797] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:51 2022] DELETE /identity/v3/projects/70c1f5197bd249fb9f2e1f618582c361 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:51.472567 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:51.482587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c8a00-8dfc-41b7-a49c-0586926b916e service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:51.536203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:51.536815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:51.537088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:51.537354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] PATH_INFO: `/v3/users/5b44b8927ad24dbcbe2bc2c68e815893` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:51.538504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b44b8927ad24dbcbe2bc2c68e815893)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:51.540421 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:51.583964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b44b8927ad24dbcbe2bc2c68e815893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.591075 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b44b8927ad24dbcbe2bc2c68e815893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.602991 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b44b8927ad24dbcbe2bc2c68e815893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.604668 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:51.613204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b44b8927ad24dbcbe2bc2c68e815893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.613839 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-0a8cb68d-9307-4e1a-a344-62f409601dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b44b8927ad24dbcbe2bc2c68e815893'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:51.620218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1410/2798] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:51 2022] DELETE /identity/v3/users/5b44b8927ad24dbcbe2bc2c68e815893 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:51.885637 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:51.889757 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:51.903918 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07677d-7441-4481-a684-e3c8bc6b6d0e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:51.934661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:51.962654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:51.963702 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:51.963975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:51.964235 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] PATH_INFO: `/v3/projects/d221f7b52d5947b1b95d87470168fdb8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:51.965328 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d221f7b52d5947b1b95d87470168fdb8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:51.967233 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.013529 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd221f7b52d5947b1b95d87470168fdb8', 'request_id': 'req-2695941b-445c-48f6-b29e-dca289f46d32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.020114 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd221f7b52d5947b1b95d87470168fdb8', 'request_id': 'req-2695941b-445c-48f6-b29e-dca289f46d32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.029588 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd221f7b52d5947b1b95d87470168fdb8', 'request_id': 'req-2695941b-445c-48f6-b29e-dca289f46d32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.041809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] The token cache is being invalidate because project d221f7b52d5947b1b95d87470168fdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:52.042135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.043690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.045424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1389/2799] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:51 2022] DELETE /identity/v3/projects/d221f7b52d5947b1b95d87470168fdb8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:52.050564 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3ea96-55c9-4993-a94b-9f28aeeba519 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.051199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3ea96-55c9-4993-a94b-9f28aeeba519 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.051510 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3ea96-55c9-4993-a94b-9f28aeeba519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.073428 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-38a3ea96-55c9-4993-a94b-9f28aeeba519 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:52.074652 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-38a3ea96-55c9-4993-a94b-9f28aeeba519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.086289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.087661 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.134597 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1411/2800] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:52.142653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.143063 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.143336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.155370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695941b-445c-48f6-b29e-dca289f46d32 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.161404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.161705 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.162085 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.162425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] PATH_INFO: `/v3/users/0c3a744195ae47f59d14e1c8dfe3cb24` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.163695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:52.164196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3a744195ae47f59d14e1c8dfe3cb24)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.164889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.166557 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.173218 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1412/2801] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:32:52.177319 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.186889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fdb4f-a6a1-48ad-b660-b32405b0289d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.192396 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.193115 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.193489 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.193838 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.194606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:52.194903 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.196826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.210006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1413/2802] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 18:32:52.214785 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.216937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3a744195ae47f59d14e1c8dfe3cb24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.224603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4524220-acec-4e46-9e89-69111a504fd8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.225147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3a744195ae47f59d14e1c8dfe3cb24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.229539 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.230315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.230663 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.230929 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.231534 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.233451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.233612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:52.239014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3a744195ae47f59d14e1c8dfe3cb24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.239815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3a744195ae47f59d14e1c8dfe3cb24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.240965 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a58e592b-95ba-444d-8b69-ded962151325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3a744195ae47f59d14e1c8dfe3cb24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.254518 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1390/2803] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:52 2022] DELETE /identity/v3/users/0c3a744195ae47f59d14e1c8dfe3cb24 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:52.259145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.259424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.260240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.268177 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1414/2804] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:52.269741 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.271406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.279384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:52.280565 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.334511 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856601f8-aba2-4744-9f2f-a90b6bf43973 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.339403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1391/2805] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 18:32:52.340130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.340736 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.341035 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.341301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.341938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.344003 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.349403 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.350765 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.368304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1415/2806] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 18:32:52.369374 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.378787 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511c74f-58a1-4c2f-90ed-3f9dace49eb0 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.383406 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.383984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.384261 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.384524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.385710 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.387322 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.397384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1416/2807] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:52.401695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.411050 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1610b-af7a-4bc3-9dd8-d960d2eaef93 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.411821 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970bdde-ba30-4217-addf-972f6632d174 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.416103 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.416456 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.416718 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.416994 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.417117 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.417261 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.417399 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.417540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.418235 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.419815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.426427 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.427840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7010e5-b5fd-42af-b38d-fc666f976dac service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.430284 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1417/2808] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:52.434743 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.438236 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1392/2809] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:32:52.444569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08c98-efbc-4e1b-b93a-b2d7a668e218 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.449947 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.450588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.450861 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.451125 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] PATH_INFO: `/v3/projects/51e6b76444a64e37adf12a6904575011/users/64d9dff0e7fc4eb583dfeda73152b83a/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.462988 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:52.466701 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e6b76444a64e37adf12a6904575011, user_id=64d9dff0e7fc4eb583dfeda73152b83a, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.469381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.484238 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1418/2810] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:52 2022] PUT /identity/v3/projects/51e6b76444a64e37adf12a6904575011/users/64d9dff0e7fc4eb583dfeda73152b83a/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:52.495613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.495896 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.496163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.528218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] MFA Rules not processed for user `64d9dff0e7fc4eb583dfeda73152b83a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:52.529415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.596520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1393/2811] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:52.601145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.667413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbb243-95f8-414b-a195-f787188264b2 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.674082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.674818 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.675101 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.675366 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] PATH_INFO: `/v3/projects` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.675986 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.677974 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.708299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1419/2812] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:52.713142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.724640 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.724935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8474c-b4b0-49ad-a145-addd1622827a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.727307 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.737738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:52.788029 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.788749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.789092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.789424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.790144 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.792140 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.797271 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4187a2c-c62c-4816-903f-60baf528788b admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.801953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.802590 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.802866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.803132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] PATH_INFO: `/v3/projects/bc6001f6c3c74eeeb831a643637a4fb5` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.804280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6001f6c3c74eeeb831a643637a4fb5)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.806393 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.814151 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1394/2813] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:52 2022] POST /identity/v3/users => generated 310 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:52.818319 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.828453 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491b26-def2-4c74-a5c2-0741dd442e27 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.834116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.834922 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.835202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.835596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.836431 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.838267 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.849070 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1395/2814] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:52.853210 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.855417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6001f6c3c74eeeb831a643637a4fb5', 'request_id': 'req-061d6787-2944-423d-b01d-77ca96563110'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.863692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6001f6c3c74eeeb831a643637a4fb5', 'request_id': 'req-061d6787-2944-423d-b01d-77ca96563110'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.863857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea755e2-208d-48e9-aa5e-8ebc54bb9a49 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:52.871755 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6001f6c3c74eeeb831a643637a4fb5', 'request_id': 'req-061d6787-2944-423d-b01d-77ca96563110'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.888045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] The token cache is being invalidate because project bc6001f6c3c74eeeb831a643637a4fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:52.888713 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.889562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:52.891971 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1420/2815] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:52 2022] DELETE /identity/v3/projects/bc6001f6c3c74eeeb831a643637a4fb5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:52.895983 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.897338 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.906926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:52.925794 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:52.926476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:52.926748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:52.927013 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] PATH_INFO: `/v3/projects/7e8067c72408442c8251802b32584292/users/26baf1df5a764806a328235d3104eb07/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:52.941762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8067c72408442c8251802b32584292, user_id=26baf1df5a764806a328235d3104eb07, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:52.944425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:52.957214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1396/2816] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:52 2022] PUT /identity/v3/projects/7e8067c72408442c8251802b32584292/users/26baf1df5a764806a328235d3104eb07/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:52.961127 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:52.962743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:52.970134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6787-2944-423d-b01d-77ca96563110 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.028935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317d60f-50ef-4a8b-bdf5-f4196e18e494 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.033417 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.033564 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.034082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.034237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.034362 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.034476 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.034586 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] PATH_INFO: `/v3/users/3adf7026a6f84895b85d2dfb9662c173` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.034700 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.035311 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.035695 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adf7026a6f84895b85d2dfb9662c173)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.036889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.037609 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.048480 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1397/2817] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:32:53.052841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:53.063298 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0c5c-090e-4abb-b7b7-a287ac289dd4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.068796 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.069491 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.069826 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.070179 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] PATH_INFO: `/v3/projects/7e8067c72408442c8251802b32584292/users/26baf1df5a764806a328235d3104eb07/roles/095db5c1c2a240ddba8b9106a7f48483` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.072621 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8067c72408442c8251802b32584292, user_id=26baf1df5a764806a328235d3104eb07, role_id=095db5c1c2a240ddba8b9106a7f48483)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.075264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988271a4-2633-4491-bb86-c9e245052ca7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.081612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:53.087583 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1398/2818] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:53 2022] PUT /identity/v3/projects/7e8067c72408442c8251802b32584292/users/26baf1df5a764806a328235d3104eb07/roles/095db5c1c2a240ddba8b9106a7f48483 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:53.089548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adf7026a6f84895b85d2dfb9662c173'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.098018 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adf7026a6f84895b85d2dfb9662c173'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.099562 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.099848 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.100123 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.110807 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adf7026a6f84895b85d2dfb9662c173'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.117504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adf7026a6f84895b85d2dfb9662c173'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.118208 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adf7026a6f84895b85d2dfb9662c173'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.124765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1421/2819] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:52 2022] DELETE /identity/v3/users/3adf7026a6f84895b85d2dfb9662c173 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:32:53.136528 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] MFA Rules not processed for user `26baf1df5a764806a328235d3104eb07`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:53.137729 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:53.210878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1399/2820] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:53 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:53.221999 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:53.223345 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:53.266744 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:53.291646 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58086-835e-4425-b9c8-91fd9e5f43fa admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.296311 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.296895 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.297173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.297442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.307207 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.308635 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.318245 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1422/2821] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:53 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:53.408057 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:53.410339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:53.477984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:53.487375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309b1f-a83f-4d0b-b0cf-8e3853529f38 service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.491069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.491730 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.492073 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.492437 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.494275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:53.499051 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65638-5cfc-4a17-9357-2d859f886bec None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.503985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.504596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.504872 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.505136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] PATH_INFO: `/v3/projects/3586c4f2956f4536b730c7452c01a808` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.506270 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3586c4f2956f4536b730c7452c01a808)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.508136 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.557152 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.557396 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3586c4f2956f4536b730c7452c01a808', 'request_id': 'req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.558634 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.563598 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3586c4f2956f4536b730c7452c01a808', 'request_id': 'req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.567936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1423/2822] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:53 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:32:53.571560 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3586c4f2956f4536b730c7452c01a808', 'request_id': 'req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.583590 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] The token cache is being invalidate because project 3586c4f2956f4536b730c7452c01a808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:53.583878 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.584519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.586030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1400/2823] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:53 2022] DELETE /identity/v3/projects/3586c4f2956f4536b730c7452c01a808 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:53.590603 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:53.601334 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef183-00be-41bb-9dcc-88c02217beac service cinder] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:53.659349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:53.660065 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:53.660419 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:53.660606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] PATH_INFO: `/v3/users/77a27bba4f994488a862c769c16d0572` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:53.661800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a27bba4f994488a862c769c16d0572)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:53.663790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:53.719815 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a27bba4f994488a862c769c16d0572'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.729682 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a27bba4f994488a862c769c16d0572'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.742664 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a27bba4f994488a862c769c16d0572'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.747275 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:53.750298 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a27bba4f994488a862c769c16d0572'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.751228 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-5c2ea8a2-4fd9-4609-a2c5-1865a420ef58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a27bba4f994488a862c769c16d0572'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:53.759514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1424/2824] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:32:53 2022] DELETE /identity/v3/users/77a27bba4f994488a862c769c16d0572 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:54.043970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.045414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:54.058964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b145d1d-5d3f-4810-81d7-53b4f3cf1f64 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.073041 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:54.118348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.118975 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.119766 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.120034 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] PATH_INFO: `/v3/projects/38ae110fc3054e07a161122437da35b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.121139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ae110fc3054e07a161122437da35b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.123092 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.168635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ae110fc3054e07a161122437da35b3', 'request_id': 'req-645e64b2-7159-4fd2-aac0-397004500186'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:54.174853 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ae110fc3054e07a161122437da35b3', 'request_id': 'req-645e64b2-7159-4fd2-aac0-397004500186'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:54.182367 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ae110fc3054e07a161122437da35b3', 'request_id': 'req-645e64b2-7159-4fd2-aac0-397004500186'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:54.192743 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] The token cache is being invalidate because project 38ae110fc3054e07a161122437da35b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:32:54.193028 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:54.193647 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-645e64b2-7159-4fd2-aac0-397004500186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:32:54.195173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1401/2825] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:32:54 2022] DELETE /identity/v3/projects/38ae110fc3054e07a161122437da35b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:54.200604 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.200907 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.201178 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.221381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:54.222694 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:54.281062 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1425/2826] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:54.288646 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.288929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.289200 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.308615 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:54.309795 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:54.317602 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1402/2827] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:54.321570 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.331671 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2b8ec-de06-4d67-a721-fa6001091150 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.336210 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.336791 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.337059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.337321 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.337992 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:32:54.338290 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.339889 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.350985 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1426/2828] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:32:54.355509 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.364357 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228970e-866c-47ea-a348-e9a91d03193d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.368964 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.370221 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.370503 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.370773 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.371392 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.373281 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.399832 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1403/2829] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:32:54 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:54.403829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.413446 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d29f-26a4-467b-a56f-f0cd4d30ac65 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.468069 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.468655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.468928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.469192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.469799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.471800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.493241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1427/2830] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:32:54 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:32:54.497972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.508216 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7c53-2c2e-4b62-89d2-c10ca2bfe63c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.513100 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.513693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.514007 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.514280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.514915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.516492 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.526675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1404/2831] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:54.530688 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.540441 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ba500-a86b-49a9-aeb0-a83486fa8d6e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.545351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.545953 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.546231 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.546496 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.547123 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.548734 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840c2d-5f08-4d20-aa7e-3576a4cff130 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.560045 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1428/2832] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:32:54.564175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.574125 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653c9e6-79e6-4542-8a27-2082d075f0c0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.578728 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.579370 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.579648 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.579921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] PATH_INFO: `/v3/projects/073dcf7173a54d70bed17173168ecee4/users/4080fee1109a42aaa628625a1593a01f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.595517 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073dcf7173a54d70bed17173168ecee4, user_id=4080fee1109a42aaa628625a1593a01f, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.598164 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.611534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1405/2833] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:32:54 2022] PUT /identity/v3/projects/073dcf7173a54d70bed17173168ecee4/users/4080fee1109a42aaa628625a1593a01f/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:32:54.622517 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84998d-86fd-45ee-a2e7-5bac90d71b21 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.622797 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84998d-86fd-45ee-a2e7-5bac90d71b21 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.623060 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84998d-86fd-45ee-a2e7-5bac90d71b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.654034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3e84998d-86fd-45ee-a2e7-5bac90d71b21 None None] MFA Rules not processed for user `4080fee1109a42aaa628625a1593a01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:32:54.655244 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3e84998d-86fd-45ee-a2e7-5bac90d71b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:54.705507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:54.723459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1429/2834] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:32:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:32:54.734619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:32:54.736291 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:32:54.784690 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:32:54.797541 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a809-12bc-49f8-ac48-627a4178ccc6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:32:54.801074 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:32:54.801671 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:32:54.801972 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:32:54.802241 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:32:54.810730 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:32:54.812128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:32:54.820770 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1406/2835] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:00.410379 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7329e6-7da3-4340-b848-54ab165fe442 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:00.410951 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7329e6-7da3-4340-b848-54ab165fe442 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:00.411061 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7329e6-7da3-4340-b848-54ab165fe442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:00.430221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-5b7329e6-7da3-4340-b848-54ab165fe442 None None] MFA Rules not processed for user `4080fee1109a42aaa628625a1593a01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:00.431439 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5b7329e6-7da3-4340-b848-54ab165fe442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:00.439130 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1430/2836] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:03.039131 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:03.040808 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.113947 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e67a6-6b8b-41ea-a7a6-0c8dbd320f76 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:03.125643 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:03.126310 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:03.126594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:03.126870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] PATH_INFO: `/v3/users/64d9dff0e7fc4eb583dfeda73152b83a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:03.128748 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d9dff0e7fc4eb583dfeda73152b83a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:03.131139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:03.194272 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d9dff0e7fc4eb583dfeda73152b83a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.204828 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d9dff0e7fc4eb583dfeda73152b83a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.218604 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d9dff0e7fc4eb583dfeda73152b83a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.219276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d9dff0e7fc4eb583dfeda73152b83a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.219887 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d9dff0e7fc4eb583dfeda73152b83a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.233035 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1407/2837] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:33:03 2022] DELETE /identity/v3/users/64d9dff0e7fc4eb583dfeda73152b83a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:03.238326 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:03.239103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:03.239395 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:03.277313 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:03.280799 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.354434 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1431/2838] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:03.363935 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:03.365348 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.426030 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223203a-30dc-4220-8a20-0513b350b02c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:03.429842 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:03.430471 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:03.430746 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:03.431240 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:03.441264 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:03.442835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:03.453472 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1408/2839] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:03.757077 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:03.758533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.839471 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bb509-f024-44f0-91e3-5ba8a679ae6c None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:03.845768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:03.848186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:03.848186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:03.848186 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:03.848507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.863499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:03.865357 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:03.876387 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1432/2840] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:03.882337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:03.887099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:03.901377 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01daf42-dddc-433b-b797-ad3b2b1bb54b service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:03.906172 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:03.906803 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:03.907083 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:03.907351 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] PATH_INFO: `/v3/projects/51e6b76444a64e37adf12a6904575011` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:03.908500 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e6b76444a64e37adf12a6904575011)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:03.910466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:03.912293 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:03.967852 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e6b76444a64e37adf12a6904575011', 'request_id': 'req-9e3b5484-821a-4f63-9f14-f9f901e80e90'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.974430 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e6b76444a64e37adf12a6904575011', 'request_id': 'req-9e3b5484-821a-4f63-9f14-f9f901e80e90'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.983190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e6b76444a64e37adf12a6904575011', 'request_id': 'req-9e3b5484-821a-4f63-9f14-f9f901e80e90'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.994835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] The token cache is being invalidate because project 51e6b76444a64e37adf12a6904575011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:33:03.995118 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.995747 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:03.997305 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1409/2841] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:33:03 2022] DELETE /identity/v3/projects/51e6b76444a64e37adf12a6904575011 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:04.001272 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.012247 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f096-9587-46aa-acd9-54ae8e5cda99 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.071368 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.072727 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.073006 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.073273 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] PATH_INFO: `/v3/users/26baf1df5a764806a328235d3104eb07` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.074430 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26baf1df5a764806a328235d3104eb07)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.076344 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:04.088495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:04.128599 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26baf1df5a764806a328235d3104eb07'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.136217 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26baf1df5a764806a328235d3104eb07'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.148855 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26baf1df5a764806a328235d3104eb07'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.157088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26baf1df5a764806a328235d3104eb07'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.157920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-45261dd1-b21a-4715-9c27-9417868b356d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26baf1df5a764806a328235d3104eb07'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.163995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1433/2842] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:33:04 2022] DELETE /identity/v3/users/26baf1df5a764806a328235d3104eb07 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:04.517584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.517584 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:04.522275 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5484-821a-4f63-9f14-f9f901e80e90 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.584313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.584932 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.585205 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.585469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] PATH_INFO: `/v3/projects/7e8067c72408442c8251802b32584292` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.586593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8067c72408442c8251802b32584292)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.588952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:04.633916 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8067c72408442c8251802b32584292', 'request_id': 'req-92e97425-3655-4528-88f2-229045225f06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.639973 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8067c72408442c8251802b32584292', 'request_id': 'req-92e97425-3655-4528-88f2-229045225f06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.647276 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8067c72408442c8251802b32584292', 'request_id': 'req-92e97425-3655-4528-88f2-229045225f06'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.657864 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] The token cache is being invalidate because project 7e8067c72408442c8251802b32584292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:33:04.658190 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.658800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-92e97425-3655-4528-88f2-229045225f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:04.660244 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1410/2843] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:33:04 2022] DELETE /identity/v3/projects/7e8067c72408442c8251802b32584292 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:04.665132 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.665655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.665655 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.686292 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:04.687507 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:04.745359 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1434/2844] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:04.753534 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.753815 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.754115 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.774148 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:04.775914 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:04.786189 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1411/2845] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:04.790628 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.800885 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999034a-56b4-4d05-b89e-fa5cd59a6a03 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.805469 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.806103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.806381 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.806649 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.807299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:33:04.807601 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.809192 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:04.820676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1435/2846] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:33:04.825547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.834772 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05745c-9c2e-47d5-b3ca-2a074af154a2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.840116 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.840713 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.840993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.841289 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.841923 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.843909 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:04.855043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:04.873044 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1412/2847] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:33:04 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:33:04.877072 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.887887 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e23a9-1731-43ed-bcea-52627a1d078e admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.942394 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.942970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.943242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.943502 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.944144 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.946067 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:04.967462 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1436/2848] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:33:04 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:33:04.971634 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:04.981640 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb9c59-fb00-47e1-836e-4ef03b265498 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:04.987776 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:04.988512 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:04.988860 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:04.989219 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:04.990022 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:04.991669 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:05.002110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1413/2849] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 18:33:05.006099 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:05.013005 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:05.016990 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddce1c1-ca8c-4286-b42a-9a6cd769a93f admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:05.023533 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:05.024488 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:05.024914 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:05.025998 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:05.026784 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:05.028442 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a03e9-36d7-407d-b69f-10782b49c055 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:05.039141 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1437/2850] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:33:05.043292 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:05.053045 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6e6c-a888-4b22-bbc4-d646b221db54 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:05.058280 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:05.058942 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:05.059218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:05.059488 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] PATH_INFO: `/v3/projects/2479893554b74fb8b2c9623210a3d378/users/83baac8fba024860813a7f84a61ceeff/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:05.074957 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2479893554b74fb8b2c9623210a3d378, user_id=83baac8fba024860813a7f84a61ceeff, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:05.077660 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:05.092569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1414/2851] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:33:05 2022] PUT /identity/v3/projects/2479893554b74fb8b2c9623210a3d378/users/83baac8fba024860813a7f84a61ceeff/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:33:05.097719 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0033-5973-422a-895c-63bb1ac796b7 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:05.098030 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0033-5973-422a-895c-63bb1ac796b7 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:05.098301 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0033-5973-422a-895c-63bb1ac796b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:05.116826 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-8deb0033-5973-422a-895c-63bb1ac796b7 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:05.118078 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-8deb0033-5973-422a-895c-63bb1ac796b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:05.177038 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1438/2852] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:05.187142 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:05.188809 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:05.243672 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76f37-6605-4e3b-8faf-eaf31ba5f07c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:05.247791 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:05.248378 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:05.248649 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:05.248915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:05.257689 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:05.259128 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:05.269135 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1415/2853] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:05.982899 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27897-ce7c-427a-aad4-fff250cc73e2 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:05.983429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27897-ce7c-427a-aad4-fff250cc73e2 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:05.983679 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27897-ce7c-427a-aad4-fff250cc73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:06.012216 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-1ca27897-ce7c-427a-aad4-fff250cc73e2 None None] MFA Rules not processed for user `83baac8fba024860813a7f84a61ceeff`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:06.013423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-1ca27897-ce7c-427a-aad4-fff250cc73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:06.083222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1439/2854] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:06.094652 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:06.096067 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:06.155442 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554837d-8436-484c-9d7c-0ab7c103930c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:06.159771 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:06.160388 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:06.160666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:06.160937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:06.170061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:06.171620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:06.180704 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1416/2855] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:07.536232 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:07.536728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:07.536728 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:07.555768 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] MFA Rules not processed for user `83baac8fba024860813a7f84a61ceeff`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:07.556955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:07.563708 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1440/2856] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:07.795313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:07.796684 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:07.808422 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d78c7-8414-4284-8dce-e3bca04c1ad1 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:07.811911 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:07.812490 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:07.812763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:07.813026 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:07.814666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:07.824201 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:07.825595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4c7d3-0d58-4ed4-8c27-2fbb11d62d2d service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:07.833330 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1417/2857] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:10.561402 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:10.563252 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:10.641239 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d7aa-de5a-401d-be49-4fe148f2ec74 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:10.647021 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:10.647623 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:10.647897 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:10.648164 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:10.649862 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:10.662147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:10.663721 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:10.674700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1441/2858] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:16.673237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfba-08a3-4397-987f-f81bdf797694 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:16.673736 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfba-08a3-4397-987f-f81bdf797694 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:16.673837 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfba-08a3-4397-987f-f81bdf797694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:16.694245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c73ecfba-08a3-4397-987f-f81bdf797694 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:16.695985 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c73ecfba-08a3-4397-987f-f81bdf797694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:16.743360 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:16.756880 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1418/2859] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:33:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:16.806044 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:16.808074 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:16.811765 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=100 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:16.908059 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826de53-24a6-49c9-aa7d-472b52daa455 service nova] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:16.917064 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:16.917692 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:16.918002 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:16.918351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:16.928645 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:16.930499 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:16.942048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1442/2860] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:33:17.487265 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bfde-b47d-474f-8587-b56c5438d6c6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:17.487550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bfde-b47d-474f-8587-b56c5438d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:17.487819 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bfde-b47d-474f-8587-b56c5438d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:17.506406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3437bfde-b47d-474f-8587-b56c5438d6c6 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:17.507609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3437bfde-b47d-474f-8587-b56c5438d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:17.517153 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1419/2861] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:17.530142 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:17.541320 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b1f9-8637-46e6-af06-acdd5805d321 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:17.546418 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:17.547029 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:17.547299 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:17.547562 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:17.555501 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:17.557080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:17.564852 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1443/2862] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:33:17.777786 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4695c-e637-4008-a3b7-cc2833f6fdce None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:17.778283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4695c-e637-4008-a3b7-cc2833f6fdce None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:17.778394 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4695c-e637-4008-a3b7-cc2833f6fdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:17.798327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-84d4695c-e637-4008-a3b7-cc2833f6fdce None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:17.799425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84d4695c-e637-4008-a3b7-cc2833f6fdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:17.807039 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1420/2863] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:17.818737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:17.829120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055744-3679-4d78-b94f-2f56ddd44736 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:17.834080 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:17.835024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:17.835024 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:17.835227 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:17.843170 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:17.844731 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:17.852928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1444/2864] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:33:18.173456 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:18.173739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:18.174037 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:18.193170 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:18.194404 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:18.202176 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1421/2865] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:18.214314 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:18.224605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccc7f-7601-4bcc-b85f-2cd554d705c1 service swift] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:18.229565 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:18.230199 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:18.230478 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:18.230746 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:18.238857 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:18.240423 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362f70-7bff-4b5f-aaa2-308c68090a31 service swift] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:18.249114 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1445/2866] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:33:20.329651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:20.331133 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:20.345666 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f049a1-5eb0-45ea-b7a9-5d3487985382 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:20.350154 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:20.350762 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:20.351036 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:20.351304 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] PATH_INFO: `/v3/users/4080fee1109a42aaa628625a1593a01f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:20.352417 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4080fee1109a42aaa628625a1593a01f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:20.355003 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:20.399499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4080fee1109a42aaa628625a1593a01f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.406596 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4080fee1109a42aaa628625a1593a01f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.418946 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4080fee1109a42aaa628625a1593a01f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.419594 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4080fee1109a42aaa628625a1593a01f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.420202 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4080fee1109a42aaa628625a1593a01f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.433397 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1422/2867] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:33:20 2022] DELETE /identity/v3/users/4080fee1109a42aaa628625a1593a01f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:20.438204 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579485-f83e-4788-9e08-840d47e80288 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:20.438687 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579485-f83e-4788-9e08-840d47e80288 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:20.438780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65579485-f83e-4788-9e08-840d47e80288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:20.458336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-65579485-f83e-4788-9e08-840d47e80288 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:20.459509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-65579485-f83e-4788-9e08-840d47e80288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:20.522725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1446/2868] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:20.533739 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:20.535196 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:20.598857 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9f9bf-1048-499b-9d7f-69df0ddcf5b9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:20.602984 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:20.604345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:20.604619 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:20.604883 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:20.614214 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:20.615624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:20.626155 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1423/2869] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:20.796680 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65579485-f83e-4788-9e08-840d47e80288 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:20.798203 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-65579485-f83e-4788-9e08-840d47e80288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:20.810516 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65579485-f83e-4788-9e08-840d47e80288 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:20.815551 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:20.816224 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:20.816585 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:20.816920 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] PATH_INFO: `/v3/projects/073dcf7173a54d70bed17173168ecee4` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:20.822759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=073dcf7173a54d70bed17173168ecee4)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:20.824790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:20.864540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:20.877526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073dcf7173a54d70bed17173168ecee4', 'request_id': 'req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.884918 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073dcf7173a54d70bed17173168ecee4', 'request_id': 'req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.892587 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073dcf7173a54d70bed17173168ecee4', 'request_id': 'req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.903093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] The token cache is being invalidate because project 073dcf7173a54d70bed17173168ecee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:33:20.903375 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.903995 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-ba9b0c58-5d9d-4a72-8f56-c64c4859fa0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:20.905487 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1447/2870] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:33:20 2022] DELETE /identity/v3/projects/073dcf7173a54d70bed17173168ecee4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:24.804635 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:24.806108 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:24.860014 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:24.864259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe15cec-644a-4806-b4bf-fab4d72d536e service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:24.914464 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:24.915061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:24.915334 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:24.915597 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:24.917934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:24.973626 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:24.975088 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3617797-c7b7-469e-a15c-3ca41b6f1121 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:24.984701 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1424/2871] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:30.900222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:34.980532 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=46 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:35.990472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:35.991022 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:35.991143 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:36.010808 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] MFA Rules not processed for user `14a26414025b4560b13fb9d741a2d7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:36.012665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:36.020093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1448/2872] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:37.024110 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:37.024639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:37.024639 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:37.027867 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:37.029294 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:37.054929 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] MFA Rules not processed for user `83baac8fba024860813a7f84a61ceeff`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:37.057187 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:37.158323 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1425/2873] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:33:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:37.249034 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4df90-f126-42ea-bf0c-98d37ee1a54d None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:37.272457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c221970fdea24fa5997ab29aa35c2f75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:37.273354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:37.273813 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:37.274257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:37.276952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:37.295173 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:37.296955 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c82a89-2e40-4cfb-abdb-72bb9b68d12b service nova] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:37.311349 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1449/2874] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 18:33:47.145751 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=25 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:47.304566 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=37 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:47.586921 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:47.588333 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:47.660858 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e083c-8a07-43f7-92dc-45ce3d422ef4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:47.666460 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:47.667192 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:47.667969 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:47.668239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:47.670071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:47.682798 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:47.684977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:47.695926 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1426/2875] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:48.210168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:48.210454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:48.210725 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:48.229890 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:33:48.231202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:48.284964 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1450/2876] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:33:48.297753 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:48.299166 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:48.366855 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b2e9-9afb-491a-ab40-f47e24158b9d service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:48.372455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:48.373053 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:48.373327 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:48.373595 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:48.381339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:48.382936 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:48.390841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1427/2877] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:33:52.084147 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:52.085984 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:52.110619 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27157fc7-2d5f-4c86-a599-3d7b5aef5efc None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:52.128572 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:52.129280 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:52.130168 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:52.130593 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:52.133157 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:52.151323 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:52.153780 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:52.170665 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1451/2878] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:33:55.436823 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:55.438944 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:55.510934 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a612f8-37d6-4ddc-be3c-5085b1a00269 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:55.516171 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:55.516800 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:55.517076 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:55.517345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] PATH_INFO: `/v3/users/1a11ea610c8e4d21ace192cba7411516` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:55.518499 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a11ea610c8e4d21ace192cba7411516)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:55.520653 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:55.542520 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:55.566608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a11ea610c8e4d21ace192cba7411516'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.574395 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a11ea610c8e4d21ace192cba7411516'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.586316 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a11ea610c8e4d21ace192cba7411516'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.586952 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a11ea610c8e4d21ace192cba7411516'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.587547 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a11ea610c8e4d21ace192cba7411516'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.599674 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1428/2879] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:33:55 2022] DELETE /identity/v3/users/1a11ea610c8e4d21ace192cba7411516 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:55.779698 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:55.791139 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a08c-c4cd-4fb9-a10c-18da840f0670 service placement] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:55.860297 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:55.860958 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:55.861240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:55.861512 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] PATH_INFO: `/v3/projects/3e159369b59f4cd9998ac7b8972ab27c` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:55.862669 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e159369b59f4cd9998ac7b8972ab27c)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:55.864569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:55.923240 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e159369b59f4cd9998ac7b8972ab27c', 'request_id': 'req-313bf3c6-96db-4105-a6dc-c59196e767e8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.934145 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e159369b59f4cd9998ac7b8972ab27c', 'request_id': 'req-313bf3c6-96db-4105-a6dc-c59196e767e8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.943103 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e159369b59f4cd9998ac7b8972ab27c', 'request_id': 'req-313bf3c6-96db-4105-a6dc-c59196e767e8'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.955869 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] The token cache is being invalidate because project 3e159369b59f4cd9998ac7b8972ab27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:33:55.956104 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.956737 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:55.958354 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1452/2880] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:33:55 2022] DELETE /identity/v3/projects/3e159369b59f4cd9998ac7b8972ab27c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:55.962365 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:55.964173 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:55.978721 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a5235-38d2-4c65-b5e1-5c08d24c8bcc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:56.041735 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:56.042901 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:56.043174 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:56.043438 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] PATH_INFO: `/v3/users/79e5f151b4ee4c0290a54f1c04977d3d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:56.044548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e5f151b4ee4c0290a54f1c04977d3d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:56.046462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:56.090613 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e5f151b4ee4c0290a54f1c04977d3d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.097624 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e5f151b4ee4c0290a54f1c04977d3d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.110160 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e5f151b4ee4c0290a54f1c04977d3d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.110806 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e5f151b4ee4c0290a54f1c04977d3d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.111414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e5f151b4ee4c0290a54f1c04977d3d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.124021 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1429/2881] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:33:55 2022] DELETE /identity/v3/users/79e5f151b4ee4c0290a54f1c04977d3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:56.293653 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:56.295416 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:56.311082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bf3c6-96db-4105-a6dc-c59196e767e8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:56.353328 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:56.403589 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:56.406716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:56.406716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:56.406716 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] PATH_INFO: `/v3/projects/919018af25904857b88089bebee37568` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:56.407440 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919018af25904857b88089bebee37568)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:56.409398 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:56.465866 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919018af25904857b88089bebee37568', 'request_id': 'req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.477278 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919018af25904857b88089bebee37568', 'request_id': 'req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.485093 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919018af25904857b88089bebee37568', 'request_id': 'req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.498348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] The token cache is being invalidate because project 919018af25904857b88089bebee37568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80186) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:33:56.498761 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.499526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-fd06f60c-4bad-4bbc-bbaa-645cfa5f1584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:33:56.501267 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1453/2882] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:33:56 2022] DELETE /identity/v3/projects/919018af25904857b88089bebee37568 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:33:59.052993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:33:59.054466 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:59.074676 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:33:59.112884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1195-042e-47c7-aae9-371a9d1320db admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:33:59.160546 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:33:59.161145 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:33:59.161424 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:33:59.161693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:33:59.163455 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:33:59.224465 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:33:59.225810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:33:59.235903 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1430/2883] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:33:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:34:05.986620 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2769-774e-4b81-a1de-a9e86dbb27f3 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:05.987154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2769-774e-4b81-a1de-a9e86dbb27f3 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:05.987154 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e2769-774e-4b81-a1de-a9e86dbb27f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:06.005940 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-b65e2769-774e-4b81-a1de-a9e86dbb27f3 None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:34:06.007134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-b65e2769-774e-4b81-a1de-a9e86dbb27f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:06.063037 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1454/2884] 10.222.0.30 () {58 vars in 1009 bytes} [Sun Aug 7 18:34:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:34:06.075047 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:06.076426 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:06.143892 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6860f-89bb-4a39-bb61-14bf7aa591d7 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:06.149343 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:06.149845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:06.150147 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:06.150414 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:06.159091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:06.160642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:06.168631 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1431/2885] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 18:34:16.056509 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:16.165489 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:21.599790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:21.600260 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:21.600373 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:21.619540 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] MFA Rules not processed for user `fc10f3b3c22d4195a1090d228e8f4ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:34:21.621332 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:21.628385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1455/2886] 10.222.0.30 () {58 vars in 967 bytes} [Sun Aug 7 18:34:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:34:21.640308 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:21.651046 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9c5c7-6e7b-4494-9eee-0df6882fc486 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:21.656463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88b0656b52c4945896874a40739b5e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:21.657073 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:21.657345 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:21.657608 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:21.665425 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:21.667612 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:21.675592 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1432/2887] 10.222.0.30 () {60 vars in 1384 bytes} [Sun Aug 7 18:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 18:34:23.559871 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:23.561337 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:23.625582 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a593-d58d-4d2e-b0c6-3ea7f35fe75e None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:23.630036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:23.630651 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:23.630938 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:23.631202 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] PATH_INFO: `/v3/users/83baac8fba024860813a7f84a61ceeff` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:23.632304 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83baac8fba024860813a7f84a61ceeff)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:23.634256 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:23.679191 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83baac8fba024860813a7f84a61ceeff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:23.686134 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83baac8fba024860813a7f84a61ceeff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:23.697759 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83baac8fba024860813a7f84a61ceeff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:23.705754 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83baac8fba024860813a7f84a61ceeff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:23.706427 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-94a4361c-d132-4069-b3cf-bb7b119ddd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83baac8fba024860813a7f84a61ceeff'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:23.712089 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1456/2888] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:34:23 2022] DELETE /identity/v3/users/83baac8fba024860813a7f84a61ceeff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:34:23.884469 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:23.896662 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e10f-e6f6-4be3-82a2-a16ed6a6e21f service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:23.952387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:23.953009 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:23.953283 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:23.953550 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] PATH_INFO: `/v3/projects/2479893554b74fb8b2c9623210a3d378` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:23.954675 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2479893554b74fb8b2c9623210a3d378)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:23.956549 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.002665 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2479893554b74fb8b2c9623210a3d378', 'request_id': 'req-595f0f08-92ab-40f8-a2a6-f63664b947db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:24.010218 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2479893554b74fb8b2c9623210a3d378', 'request_id': 'req-595f0f08-92ab-40f8-a2a6-f63664b947db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:24.018862 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2479893554b74fb8b2c9623210a3d378', 'request_id': 'req-595f0f08-92ab-40f8-a2a6-f63664b947db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:24.029958 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] The token cache is being invalidate because project 2479893554b74fb8b2c9623210a3d378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:34:24.030248 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:24.030869 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-595f0f08-92ab-40f8-a2a6-f63664b947db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:34:24.032384 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1433/2889] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:34:23 2022] DELETE /identity/v3/projects/2479893554b74fb8b2c9623210a3d378 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:34:24.037241 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.037520 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.037790 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.060967 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:34:24.062213 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:24.119497 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1457/2890] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:34:24.127693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.127979 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.128252 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.148313 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:34:24.149501 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:24.157337 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1434/2891] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:34:24.161348 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.170979 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2878-75ec-4036-b521-9e3e668d9528 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.175390 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.175970 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.176242 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.176504 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.177137 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80186) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 18:34:24.177433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.179048 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.187932 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:24.191464 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1458/2892] 10.222.0.30 () {58 vars in 1153 bytes} [Sun Aug 7 18:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 18:34:24.195752 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.205687 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a507-4940-46a4-b72c-ecaa1b01b372 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.210387 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.210976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.211256 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.211523 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.212139 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.214043 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.240048 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1435/2893] 10.222.0.30 () {60 vars in 1153 bytes} [Sun Aug 7 18:34:24 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:34:24.244493 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.255031 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d5414-9e94-47d6-9d19-7408e94fcf47 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.311505 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.312128 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.312404 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.312676 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.313288 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.315219 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.335433 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1459/2894] 10.222.0.30 () {60 vars in 1144 bytes} [Sun Aug 7 18:34:24 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 18:34:24.339609 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.349654 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12b93-bb64-4f2f-9d67-7ce1175127a5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.354780 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.355368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.355642 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.355907 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.356535 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.358146 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.367749 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1436/2895] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:34:24.372082 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.381606 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c82e1-0338-4af4-820b-476fb5f79d36 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.386119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.386821 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.387097 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.387365 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.387989 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.389548 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875579a2-d580-40fc-aa55-e6af99c98233 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.400161 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1460/2896] 10.222.0.30 () {58 vars in 1122 bytes} [Sun Aug 7 18:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 18:34:24.404285 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.413962 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f797f2-df20-428d-b111-5371956b096b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.419063 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.419693 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.419970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.420238 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] PATH_INFO: `/v3/projects/6a295970d1794ccf884153a33ccd4f03/users/5068500f55924590bb456839431af602/roles/02e0e6ea5d5742a9ba9df0b9cef154f8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.436371 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a295970d1794ccf884153a33ccd4f03, user_id=5068500f55924590bb456839431af602, role_id=02e0e6ea5d5742a9ba9df0b9cef154f8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.439006 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.451902 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1437/2897] 10.222.0.30 () {60 vars in 1483 bytes} [Sun Aug 7 18:34:24 2022] PUT /identity/v3/projects/6a295970d1794ccf884153a33ccd4f03/users/5068500f55924590bb456839431af602/roles/02e0e6ea5d5742a9ba9df0b9cef154f8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 18:34:24.462194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] REQUEST_METHOD: `POST` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.462526 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.462800 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.489616 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.auth.core [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] MFA Rules not processed for user `5068500f55924590bb456839431af602`. Rule list: `[]` (Enabled: `True`). {{(pid=80186) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:34:24.490830 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:24.553088 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1461/2898] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:34:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:34:24.564738 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:34:24.566463 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:34:24.580627 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:24.624937 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c66c5-eb4b-4470-a11d-14a4a131eb88 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:34:24.628591 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45b5ef7c1c6a4698bd122c8d7327c723', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:34:24.629188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:34:24.629461 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:34:24.629727 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:34:24.637889 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:34:24.639314 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefa4e4-4a7a-43fc-9096-3c8da1a42d10 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:34:24.648052 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1438/2899] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:34:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:34:34.550257 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:34:34.643977 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=20 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:35:06.898342 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:06.958778 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3380d2-97a9-4274-9eca-8e9f7b0c3927 None None] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:06.963222 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:06.963832 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:06.964105 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:06.964371 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] PATH_INFO: `/v3/users/5068500f55924590bb456839431af602` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:06.965459 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5068500f55924590bb456839431af602)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:06.967957 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:07.011883 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5068500f55924590bb456839431af602'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.019283 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5068500f55924590bb456839431af602'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.031798 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5068500f55924590bb456839431af602'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.038588 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5068500f55924590bb456839431af602'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.039226 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5068500f55924590bb456839431af602'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.045577 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1462/2900] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:35:06 2022] DELETE /identity/v3/users/5068500f55924590bb456839431af602 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:07.050339 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:07.050840 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:07.050959 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:07.069781 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] MFA Rules not processed for user `beb9f8a0db28411a976c62690df62487`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 18:35:07.070976 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:07.128763 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1439/2901] 10.222.0.30 () {58 vars in 958 bytes} [Sun Aug 7 18:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 18:35:07.138336 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:07.139776 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:07.196476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efc8d-a7d8-443c-a3c3-94e0e842a5a8 admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:07.200036 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:07.200625 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:07.200926 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:07.201188 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:07.209943 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:07.211351 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:07.220451 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1463/2902] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:35:07.486993 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:35:07.488777 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:35:07.502368 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb78b0-3096-466b-9040-284f9c48d0de None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:35:07.507259 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:35:07.507835 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:35:07.508109 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:35:07.508462 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] PATH_INFO: `/v3/projects/6a295970d1794ccf884153a33ccd4f03` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:35:07.509569 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a295970d1794ccf884153a33ccd4f03)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:35:07.511519 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:35:07.557841 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a295970d1794ccf884153a33ccd4f03', 'request_id': 'req-2d69343b-5301-454f-8a16-d218ba6adaf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.563912 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a295970d1794ccf884153a33ccd4f03', 'request_id': 'req-2d69343b-5301-454f-8a16-d218ba6adaf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.571091 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a295970d1794ccf884153a33ccd4f03', 'request_id': 'req-2d69343b-5301-454f-8a16-d218ba6adaf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.581239 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] The token cache is being invalidate because project 6a295970d1794ccf884153a33ccd4f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:35:07.581521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.582163 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:35:07.583616 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1440/2903] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:35:07 2022] DELETE /identity/v3/projects/6a295970d1794ccf884153a33ccd4f03 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:35:17.216952 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:35:17.578245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:05.144624 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:05.153472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07f238-01ef-49fa-b1ba-bcfe3b8a94c6 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:05.220884 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:05.221560 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:05.221834 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:05.222133 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:05.224384 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:05.234793 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:05.236546 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:05.246268 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1464/2904] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:36:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:36:05.266253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:05.268375 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:05.283740 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69343b-5301-454f-8a16-d218ba6adaf8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:05.289246 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:05.290112 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:05.290459 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:05.290697 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:05.292651 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:05.372868 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:05.374423 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:05.386810 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1441/2905] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:36:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:36:06.577457 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:06.578948 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:06.590111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1bb21-d465-4c9d-9d63-a3e7d4045277 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:06.593976 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:06.594580 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:06.594853 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:06.595119 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:06.596820 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:06.610385 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:06.611811 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:06.622707 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1465/2906] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:36:15.381600 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=34 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:16.367593 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:16.376294 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67c11-b716-4bce-aef6-de8d91246c9a service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:16.380510 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21b6715254e34797a3af9b291d26b1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:16.381099 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:16.381374 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:16.381641 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:16.383484 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:16.446854 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:16.448447 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:16.458188 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1442/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:36:16.617724 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=32 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:22.406187 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:22.407672 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:22.424420 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d7e0-d42d-4cea-97e5-3c609f35ea53 service neutron] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:22.429285 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:22.429980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:22.430255 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:22.430519 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] PATH_INFO: `/v3/users/14a26414025b4560b13fb9d741a2d7be` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:22.431697 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a26414025b4560b13fb9d741a2d7be)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:22.433631 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:22.484485 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a26414025b4560b13fb9d741a2d7be'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.491775 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a26414025b4560b13fb9d741a2d7be'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.504670 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a26414025b4560b13fb9d741a2d7be'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.511429 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a26414025b4560b13fb9d741a2d7be'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.512111 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a26414025b4560b13fb9d741a2d7be'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.517888 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1466/2908] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:36:22 2022] DELETE /identity/v3/users/14a26414025b4560b13fb9d741a2d7be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:36:22.689620 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:22.700663 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356178b0-08dc-4ddb-88e8-365e39f716cd service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:22.757521 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:22.758175 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:22.758504 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:22.758884 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] PATH_INFO: `/v3/projects/fd034552dfeb488592e546185a421515` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:22.760071 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd034552dfeb488592e546185a421515)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:22.761992 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:22.807253 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd034552dfeb488592e546185a421515', 'request_id': 'req-33f6ec95-6e08-4e09-9913-6fd8d806b793'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.813237 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd034552dfeb488592e546185a421515', 'request_id': 'req-33f6ec95-6e08-4e09-9913-6fd8d806b793'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.820963 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd034552dfeb488592e546185a421515', 'request_id': 'req-33f6ec95-6e08-4e09-9913-6fd8d806b793'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.831406 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] The token cache is being invalidate because project fd034552dfeb488592e546185a421515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:36:22.831699 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.833061 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.834581 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1443/2909] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:36:22 2022] DELETE /identity/v3/projects/fd034552dfeb488592e546185a421515 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:36:22.838605 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:22.840000 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:22.852980 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9114bf-d80c-4aa2-ab32-785c04f3f07a admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:22.910249 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:22.910876 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:22.911149 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:22.911413 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] PATH_INFO: `/v3/users/d257687f42fa46158ec50cb8fe0598ac` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:22.912524 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d257687f42fa46158ec50cb8fe0598ac)` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:22.914460 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:22.960221 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd257687f42fa46158ec50cb8fe0598ac'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.967569 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd257687f42fa46158ec50cb8fe0598ac'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.979770 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd257687f42fa46158ec50cb8fe0598ac'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.981700 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:22.989495 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd257687f42fa46158ec50cb8fe0598ac'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.990315 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.notifications [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd257687f42fa46158ec50cb8fe0598ac'} {{(pid=80186) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:22.996293 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1467/2910] 10.222.0.30 () {58 vars in 1224 bytes} [Sun Aug 7 18:36:22 2022] DELETE /identity/v3/users/d257687f42fa46158ec50cb8fe0598ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:36:23.170412 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:36:23.171915 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:36:23.188579 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6ec95-6e08-4e09-9913-6fd8d806b793 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:36:23.209885 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:23.247415 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb9f8a0db28411a976c62690df62487', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca66a08084ae46fb86e1033ed40d8182', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:36:23.247970 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:36:23.248245 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:36:23.248511 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] PATH_INFO: `/v3/projects/76a3ffff55744ae89b89d1de82816c47` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:36:23.249611 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a3ffff55744ae89b89d1de82816c47)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:36:23.251548 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:36:23.296309 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a3ffff55744ae89b89d1de82816c47', 'request_id': 'req-01c7f36f-1806-411f-9d11-a2ad5797618b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:23.302845 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a3ffff55744ae89b89d1de82816c47', 'request_id': 'req-01c7f36f-1806-411f-9d11-a2ad5797618b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:23.309709 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a3ffff55744ae89b89d1de82816c47', 'request_id': 'req-01c7f36f-1806-411f-9d11-a2ad5797618b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:23.319804 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] The token cache is being invalidate because project 76a3ffff55744ae89b89d1de82816c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 18:36:23.320090 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:23.320698 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-01c7f36f-1806-411f-9d11-a2ad5797618b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 18:36:23.322177 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1444/2911] 10.222.0.30 () {58 vars in 1233 bytes} [Sun Aug 7 18:36:23 2022] DELETE /identity/v3/projects/76a3ffff55744ae89b89d1de82816c47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 18:36:32.992829 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=4 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:36:33.316870 dv-cinder-849846-9-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 18:39:18.633454 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Authenticating user token {{(pid=80186) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 18:39:18.634936 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:39:18.772347 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5dda5-8d6d-4e70-9ab3-0d38f7243abf admin admin] Validating token access rules against request {{(pid=80186) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 18:39:18.829642 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbcc51e7684049648ca969b9f7c97c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66cd4213348b4082a5c9c4eedfffdff6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80186) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 18:39:18.830194 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] REQUEST_METHOD: `GET` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 18:39:18.830472 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] SCRIPT_NAME: `/identity` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 18:39:18.830739 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80186) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 18:39:18.832514 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.fernet_utils [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80186) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 18:39:18.843928 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 18:39:18.845476 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8b30-c17c-4a77-b339-e70be8e47af3 service placement] RBAC: Authorization granted {{(pid=80186) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 18:39:18.855120 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: [pid: 80186|app: 0|req: 1468/2912] 10.222.0.30 () {60 vars in 1365 bytes} [Sun Aug 7 18:39:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 18:39:28.850982 dv-cinder-849846-9-iscsi devstack@keystone.service[80186]: DEBUG dbcounter [-] [80186] Writing DB stats keystone:SELECT=89 {{(pid=80186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}